2024-09-17T07:38:57.563 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T07:38:57.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T07:38:57.703 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7908726 branch: wip-bharath9-testing-2024-09-13-1444-quincy description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} email: sangadi@redhat.com first_in_suite: false job_id: '7908726' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-bharath9-testing-2024-09-13-1444-quincy ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: d75f23820806da622f561ee5ee7551015285993f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d75f23820806da622f561ee5ee7551015285993f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath9-testing-2024-09-13-1444-quincy sha1: d75f23820806da622f561ee5ee7551015285993f owner: scheduled_sangadi@teuthology priority: 130 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 9764 sha1: d75f23820806da622f561ee5ee7551015285993f sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-bharath9-testing-2024-09-13-1444-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d75f23820806da622f561ee5ee7551015285993f targets: smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_07:28:46 tube: smithi user: sangadi verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T07:38:57.703 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa; will attempt to use it 2024-09-17T07:38:57.704 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks 2024-09-17T07:38:57.704 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T07:38:57.706 INFO:teuthology.task.internal:Checking packages... 2024-09-17T07:38:57.730 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd75f23820806da622f561ee5ee7551015285993f' 2024-09-17T07:38:57.730 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T07:38:57.730 INFO:teuthology.packaging:ref: None 2024-09-17T07:38:57.730 INFO:teuthology.packaging:tag: None 2024-09-17T07:38:57.730 INFO:teuthology.packaging:branch: wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-17T07:38:57.730 INFO:teuthology.packaging:sha1: d75f23820806da622f561ee5ee7551015285993f 2024-09-17T07:38:57.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-17T07:38:57.877 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1643-gd75f2382-1focal 2024-09-17T07:38:57.879 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T07:38:57.885 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T07:38:57.885 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T07:38:57.898 INFO:teuthology.task.internal:Saving configuration 2024-09-17T07:38:57.912 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T07:38:57.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T07:38:57.948 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7908726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 07:32:21.605983', 'locked_by': 'scheduled_sangadi@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-17T07:38:57.948 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T07:38:57.954 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-17T07:38:57.955 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T07:38:57.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f83194bfac0>, signals=[15]) 2024-09-17T07:38:57.991 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T07:38:57.997 INFO:teuthology.task.internal:Opening connections... 2024-09-17T07:38:57.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T07:38:57.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:38:58.095 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T07:38:58.102 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-09-17T07:38:58.219 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-09-17T07:38:58.219 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-09-17T07:38:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2024-09-17T07:38:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-17T07:38:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2024-09-17T07:38:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2024-09-17T07:38:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-17T07:38:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04" 2024-09-17T07:38:58.227 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T07:38:58.227 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T07:38:58.227 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T07:38:58.227 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T07:38:58.227 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal 2024-09-17T07:38:58.227 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal 2024-09-17T07:38:58.227 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-09-17T07:38:58.251 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T07:38:58.259 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T07:38:58.264 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T07:38:58.265 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-09-17T07:38:58.273 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T07:38:58.282 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T07:38:58.282 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-09-17T07:38:58.294 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T07:38:58.325 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T07:38:58.345 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T07:38:58.346 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T07:38:58.346 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T07:38:58.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:38:58.354 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-09-17T07:38:58.402 INFO:teuthology.orchestra.run.smithi184.stdout:5.4.0-124-generic 2024-09-17T07:38:58.402 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.4.0-124-generic 2024-09-17T07:38:58.402 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2024-09-17T07:38:58.514 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2024-09-17T07:38:58.822 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-17T07:38:58.822 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-17T07:38:58.865 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-17T07:38:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-17T07:38:59.297 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-17T07:38:59.443 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,594 kB] 2024-09-17T07:38:59.662 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-17T07:38:59.854 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-17T07:38:59.868 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-17T07:38:59.869 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-17T07:38:59.910 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,036 kB] 2024-09-17T07:38:59.926 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [553 kB] 2024-09-17T07:38:59.935 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-17T07:38:59.936 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,275 kB] 2024-09-17T07:38:59.958 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-17T07:38:59.963 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-17T07:38:59.972 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-17T07:38:59.972 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-17T07:38:59.993 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-17T07:39:00.022 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-17T07:39:00.025 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-17T07:39:00.026 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [458 kB] 2024-09-17T07:39:00.029 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-17T07:39:00.030 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-17T07:39:00.030 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-17T07:39:00.033 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-17T07:39:00.033 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-17T07:39:00.089 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-17T07:39:00.102 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-17T07:39:00.102 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-17T07:39:00.102 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-17T07:39:00.106 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-17T07:39:00.106 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-17T07:39:00.107 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-17T07:39:00.179 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-17T07:39:00.179 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-17T07:39:00.179 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-17T07:39:00.179 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-17T07:39:00.180 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-17T07:39:00.261 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-17T07:39:00.262 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-17T07:39:00.262 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-17T07:39:04.225 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 21.9 MB in 4s (6,077 kB/s) 2024-09-17T07:39:05.771 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-09-17T07:39:05.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T07:39:05.879 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-09-17T07:39:06.098 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-09-17T07:39:06.099 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-09-17T07:39:06.305 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2024-09-17T07:39:06.305 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-17T07:39:06.305 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-generic linux-image-5.4.0-196-generic 2024-09-17T07:39:06.306 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-5.4.0-196-generic linux-modules-extra-5.4.0-196-generic 2024-09-17T07:39:06.306 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2024-09-17T07:39:06.307 INFO:teuthology.orchestra.run.smithi184.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-17T07:39:06.307 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2024-09-17T07:39:06.307 INFO:teuthology.orchestra.run.smithi184.stdout: thermald 2024-09-17T07:39:06.362 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2024-09-17T07:39:06.362 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-5.4.0-196 linux-headers-5.4.0-196-generic 2024-09-17T07:39:06.362 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-196-generic linux-modules-5.4.0-196-generic 2024-09-17T07:39:06.362 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-extra-5.4.0-196-generic 2024-09-17T07:39:06.363 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2024-09-17T07:39:06.364 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-17T07:39:06.418 INFO:teuthology.orchestra.run.smithi184.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-17T07:39:06.418 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 77.2 MB of archives. 2024-09-17T07:39:06.419 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-17T07:39:06.419 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-196-generic amd64 5.4.0-196.216 [15.0 MB] 2024-09-17T07:39:06.742 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-196-generic amd64 5.4.0-196.216 [10.5 MB] 2024-09-17T07:39:06.836 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-196-generic amd64 5.4.0-196.216 [39.2 MB] 2024-09-17T07:39:07.343 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.196.194 [1,900 B] 2024-09-17T07:39:07.343 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.196.194 [2,592 B] 2024-09-17T07:39:07.343 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196 all 5.4.0-196.216 [11.0 MB] 2024-09-17T07:39:07.439 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-196-generic amd64 5.4.0-196.216 [1,386 kB] 2024-09-17T07:39:07.449 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.196.194 [2,460 B] 2024-09-17T07:39:08.134 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 77.2 MB in 1s (71.6 MB/s) 2024-09-17T07:39:08.334 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-5.4.0-196-generic. 2024-09-17T07:39:10.115 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-17T07:39:10.119 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../0-linux-modules-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-17T07:39:10.261 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:12.261 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-image-5.4.0-196-generic. 2024-09-17T07:39:12.274 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../1-linux-image-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-17T07:39:12.354 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:13.431 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-196-generic. 2024-09-17T07:39:13.445 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-17T07:39:13.481 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:18.473 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../3-linux-generic_5.4.0.196.194_amd64.deb ... 2024-09-17T07:39:18.621 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-17T07:39:18.956 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.196.194_amd64.deb ... 2024-09-17T07:39:19.100 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-17T07:39:19.444 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.4.0-196. 2024-09-17T07:39:19.460 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../5-linux-headers-5.4.0-196_5.4.0-196.216_all.deb ... 2024-09-17T07:39:19.503 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-17T07:39:25.131 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.4.0-196-generic. 2024-09-17T07:39:25.153 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../6-linux-headers-5.4.0-196-generic_5.4.0-196.216_amd64.deb ... 2024-09-17T07:39:25.197 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:28.025 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.196.194_amd64.deb ... 2024-09-17T07:39:28.177 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-generic (5.4.0.196.194) over (5.4.0.124.125) ... 2024-09-17T07:39:28.530 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.4.0-196 (5.4.0-196.216) ... 2024-09-17T07:39:28.682 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:28.808 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-generic (5.4.0.196.194) ... 2024-09-17T07:39:28.959 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:30.211 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:31.381 INFO:teuthology.orchestra.run.smithi184.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-196-generic 2024-09-17T07:39:31.381 INFO:teuthology.orchestra.run.smithi184.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-196-generic 2024-09-17T07:39:31.547 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-extra-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:32.723 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-generic (5.4.0.196.194) ... 2024-09-17T07:39:32.874 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-generic (5.4.0.196.194) ... 2024-09-17T07:39:33.001 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for linux-image-5.4.0-196-generic (5.4.0-196.216) ... 2024-09-17T07:39:33.101 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-17T07:39:33.101 INFO:teuthology.orchestra.run.smithi184.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-196-generic 2024-09-17T07:39:54.992 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-17T07:39:54.992 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub' 2024-09-17T07:39:55.013 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T07:39:55.033 INFO:teuthology.orchestra.run.smithi184.stdout:Generating grub configuration file ... 2024-09-17T07:39:55.388 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-17T07:39:55.412 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-17T07:39:55.798 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-17T07:39:55.808 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-17T07:39:57.613 INFO:teuthology.orchestra.run.smithi184.stdout:done 2024-09-17T07:39:58.095 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2024-09-17T07:39:58.142 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2024-09-17T07:39:58.142 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2024-09-17T07:39:58.142 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2024-09-17T07:39:58.142 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2024-09-17T07:39:58.142 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 20 2024-09-17T07:39:58.142 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T07:39:58.142 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.4.0.196.194 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2024-09-17T07:39:58.143 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2024-09-17T07:39:58.143 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-196-generic 2024-09-17T07:39:58.144 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T07:39:58.144 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T07:39:58.144 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T07:39:58.144 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T07:39:58.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2024-09-17T07:39:58.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2024-09-17T07:39:58.494 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-17T07:39:58.494 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-17T07:39:58.564 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-17T07:39:58.646 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-17T07:40:00.384 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-09-17T07:40:00.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-17T07:40:00.484 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-09-17T07:40:00.704 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-09-17T07:40:00.705 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-09-17T07:40:00.946 INFO:teuthology.orchestra.run.smithi184.stdout:linux-image-generic is already the newest version (5.4.0.196.194). 2024-09-17T07:40:00.946 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-17T07:40:00.948 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2024-09-17T07:40:00.968 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2024-09-17T07:40:00.968 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2024-09-17T07:40:00.968 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 20 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.4.0.196.194 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.4.0-196-generic, linux-modules-extra-5.4.0-196-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2024-09-17T07:40:00.969 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2024-09-17T07:40:00.970 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2024-09-17T07:40:00.970 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2024-09-17T07:40:00.970 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-09-17T07:40:00.974 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.PfOBHR1go7 2024-09-17T07:40:00.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub/grub.cfg /tmp/tmp.PfOBHR1go7 2024-09-17T07:40:01.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.PfOBHR1go7 2024-09-17T07:40:01.070 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.PfOBHR1go7 is 9KB 2024-09-17T07:40:01.085 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.PfOBHR1go7 2024-09-17T07:40:01.092 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-17T07:40:01.145 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:40:01.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-17T07:40:01.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-17T07:40:01.178 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-196-generic 2024-09-17T07:40:01.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo update-grub 2024-09-17T07:40:02.623 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2024-09-17T07:40:02.628 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T07:40:02.646 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-09-17T07:40:02.940 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-196-generic 2024-09-17T07:40:02.951 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-196-generic 2024-09-17T07:40:03.352 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-17T07:40:03.363 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-17T07:40:04.149 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-09-17T07:40:04.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-09-17T07:40:34.184 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T07:40:34.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-17T07:40:34.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:40:52.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-09-17T07:41:01.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-17T07:41:01.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:41:04.733 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-09-17T07:41:16.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-17T07:41:16.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:41:48.466 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-09-17T07:41:49.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-17T07:41:49.065 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-196-generic"... 2024-09-17T07:41:49.065 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-09-17T07:41:49.071 INFO:teuthology.orchestra.run.smithi184.stdout:5.4.0-196-generic 2024-09-17T07:41:49.071 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-196-generic vs 5.4.0-196-generic 2024-09-17T07:41:49.072 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T07:41:49.072 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T07:41:50.072 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T07:41:50.073 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T07:41:50.161 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-09-17T07:41:50.179 DEBUG:teuthology.parallel:result is None 2024-09-17T07:41:50.179 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T07:41:50.187 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T07:41:50.188 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T07:41:50.194 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T07:41:50.209 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T07:41:50.219 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T07:41:50.219 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T07:41:50.244 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T07:41:50.251 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T07:41:50.251 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T07:41:50.308 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T07:41:50.319 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T07:41:50.320 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T07:41:50.327 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T07:41:50.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T07:41:50.342 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T07:41:50.352 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T07:41:50.352 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T07:41:50.391 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T07:41:50.398 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T07:41:50.405 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:41:50.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T07:41:50.424 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-09-17T07:41:50.466 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T07:41:50.473 INFO:teuthology.task.internal:Starting timer... 2024-09-17T07:41:50.473 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T07:41:50.487 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T07:41:50.498 DEBUG:teuthology.task.selinux:Excluding smithi184: OS 'ubuntu' does not support SELinux 2024-09-17T07:41:50.498 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T07:41:50.499 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T07:41:50.499 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T07:41:50.499 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T07:41:50.506 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T07:41:50.519 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T07:41:50.521 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T07:47:23.338 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-09-17T07:47:23.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-17T07:47:23.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T07:47:23.450 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-09-17T07:47:23.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-09-17T07:47:23.571 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T07:47:23.585 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T07:47:23.586 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T07:47:23.586 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T07:47:23.622 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-17T07:47:23.622 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Command line: ntpd -gq 2024-09-17T07:47:23.623 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: proto: precision = 0.117 usec (-23) 2024-09-17T07:47:23.624 INFO:teuthology.orchestra.run.smithi184.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T07:47:23.624 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T07:47:23.624 INFO:teuthology.orchestra.run.smithi184.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T07:47:23.625 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T07:47:23.625 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T07:47:23.625 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T07:47:23.626 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T07:47:23.626 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Listen normally on 3 enp3s0f1 172.21.15.184:123 2024-09-17T07:47:23.626 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Listen normally on 4 lo [::1]:123 2024-09-17T07:47:23.626 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b8f%5]:123 2024-09-17T07:47:23.626 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:23 ntpd[13794]: Listening on routing socket on fd #22 for interface updates 2024-09-17T07:47:24.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:24 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:24.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:24 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:24.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:24 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:24.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:24 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:24.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:24 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:24.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:24 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:26.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:26.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:26.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:26 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:28.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:28.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:28 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:30.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:30.623 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T07:47:30.624 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T07:47:30.625 INFO:teuthology.orchestra.run.smithi184.stdout:17 Sep 07:47:30 ntpd[13794]: ntpd: time slew +0.000247 s 2024-09-17T07:47:30.625 INFO:teuthology.orchestra.run.smithi184.stdout:ntpd: time slew +0.000247s 2024-09-17T07:47:30.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T07:47:30.625 INFO:teuthology.orchestra.run.smithi184.stderr:17 Sep 07:47:30 ntpd[13794]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T07:47:30.700 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T07:47:30.700 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2024-09-17T07:47:30.700 INFO:teuthology.orchestra.run.smithi184.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-17T07:47:30.700 INFO:teuthology.orchestra.run.smithi184.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-17T07:47:30.700 INFO:teuthology.orchestra.run.smithi184.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-17T07:47:30.700 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-17T07:47:30.701 INFO:teuthology.run_tasks:Running task install... 2024-09-17T07:47:30.708 DEBUG:teuthology.task.install:project ceph 2024-09-17T07:47:30.709 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}} 2024-09-17T07:47:30.709 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'} 2024-09-17T07:47:30.709 INFO:teuthology.task.install:Using flavor: default 2024-09-17T07:47:30.714 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T07:47:30.714 INFO:teuthology.task.install:extra packages: [] 2024-09-17T07:47:30.715 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2024-09-17T07:47:30.841 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-17T07:47:30.901 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T07:47:30.901 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T07:47:30.902 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-17T07:47:30.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d75f23820806da622f561ee5ee7551015285993f 2024-09-17T07:47:31.068 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default/ 2024-09-17T07:47:31.068 INFO:teuthology.task.install.deb:Package version is 17.2.7-1643-gd75f2382-1focal 2024-09-17T07:47:31.267 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:47:31.268 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T07:47:31.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2024-09-17T07:47:31.603 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-17T07:47:31.609 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-17T07:47:31.617 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal InRelease 2024-09-17T07:47:31.640 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-17T07:47:31.663 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal Release.gpg 2024-09-17T07:47:31.672 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-17T07:47:31.686 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-09-17T07:47:31.729 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main i386 Packages [3,392 B] 2024-09-17T07:47:31.754 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-17T07:47:32.270 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 28.5 kB in 1s (36.8 kB/s) 2024-09-17T07:47:33.433 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-09-17T07:47:33.460 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1643-gd75f2382-1focal cephadm=17.2.7-1643-gd75f2382-1focal ceph-mds=17.2.7-1643-gd75f2382-1focal ceph-mgr=17.2.7-1643-gd75f2382-1focal ceph-common=17.2.7-1643-gd75f2382-1focal ceph-fuse=17.2.7-1643-gd75f2382-1focal ceph-test=17.2.7-1643-gd75f2382-1focal ceph-volume=17.2.7-1643-gd75f2382-1focal radosgw=17.2.7-1643-gd75f2382-1focal python3-rados=17.2.7-1643-gd75f2382-1focal python3-rgw=17.2.7-1643-gd75f2382-1focal python3-cephfs=17.2.7-1643-gd75f2382-1focal python3-rbd=17.2.7-1643-gd75f2382-1focal libcephfs2=17.2.7-1643-gd75f2382-1focal libcephfs-dev=17.2.7-1643-gd75f2382-1focal librados2=17.2.7-1643-gd75f2382-1focal librbd1=17.2.7-1643-gd75f2382-1focal rbd-fuse=17.2.7-1643-gd75f2382-1focal 2024-09-17T07:47:33.533 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-09-17T07:47:33.738 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-09-17T07:47:33.739 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-09-17T07:47:33.941 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T07:47:33.943 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-17T07:47:33.943 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T07:47:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2024-09-17T07:47:33.944 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T07:47:33.944 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-17T07:47:33.944 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-17T07:47:33.944 INFO:teuthology.orchestra.run.smithi184.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-17T07:47:33.944 INFO:teuthology.orchestra.run.smithi184.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-17T07:47:33.946 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-17T07:47:33.946 INFO:teuthology.orchestra.run.smithi184.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-09-17T07:47:33.946 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-09-17T07:47:33.946 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2024-09-17T07:47:33.946 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-17T07:47:33.946 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-17T07:47:33.947 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-17T07:47:33.947 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-17T07:47:33.947 INFO:teuthology.orchestra.run.smithi184.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T07:47:33.947 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-17T07:47:33.947 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2024-09-17T07:47:33.947 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2024-09-17T07:47:33.947 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T07:47:33.948 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2024-09-17T07:47:33.948 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2024-09-17T07:47:33.948 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2024-09-17T07:47:33.948 INFO:teuthology.orchestra.run.smithi184.stdout: socat xmlstarlet 2024-09-17T07:47:33.948 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2024-09-17T07:47:33.948 INFO:teuthology.orchestra.run.smithi184.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-17T07:47:33.948 INFO:teuthology.orchestra.run.smithi184.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-17T07:47:33.949 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2024-09-17T07:47:33.950 INFO:teuthology.orchestra.run.smithi184.stdout: btrfs-tools 2024-09-17T07:47:34.069 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2024-09-17T07:47:34.069 INFO:teuthology.orchestra.run.smithi184.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T07:47:34.069 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T07:47:34.069 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-17T07:47:34.070 INFO:teuthology.orchestra.run.smithi184.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2024-09-17T07:47:34.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-17T07:47:34.072 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2024-09-17T07:47:34.073 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 librbd1 2024-09-17T07:47:34.138 INFO:teuthology.orchestra.run.smithi184.stdout:2 upgraded, 108 newly installed, 0 to remove and 295 not upgraded. 2024-09-17T07:47:34.138 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 201 MB of archives. 2024-09-17T07:47:34.138 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 938 MB of additional disk space will be used. 2024-09-17T07:47:34.138 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-17T07:47:34.220 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-17T07:47:34.222 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-17T07:47:34.231 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-17T07:47:34.233 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-17T07:47:34.255 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1643-gd75f2382-1focal [3,508 kB] 2024-09-17T07:47:34.260 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-17T07:47:34.262 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-17T07:47:34.267 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-17T07:47:34.299 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-17T07:47:34.301 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-17T07:47:34.307 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-17T07:47:34.309 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-17T07:47:34.310 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-17T07:47:34.312 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-17T07:47:34.312 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-17T07:47:34.313 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-17T07:47:34.313 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-17T07:47:34.317 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-17T07:47:34.334 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-17T07:47:34.334 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-17T07:47:34.335 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-17T07:47:34.336 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-17T07:47:34.337 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T07:47:34.338 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-17T07:47:34.338 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-17T07:47:34.340 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-17T07:47:34.341 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-17T07:47:34.351 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-17T07:47:34.359 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-17T07:47:34.360 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-17T07:47:34.366 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-17T07:47:34.367 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-17T07:47:34.367 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-17T07:47:34.368 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-17T07:47:34.369 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-17T07:47:34.372 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-17T07:47:34.373 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T07:47:34.384 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-17T07:47:34.385 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-17T07:47:34.387 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-17T07:47:34.387 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-17T07:47:34.401 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-17T07:47:34.402 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-17T07:47:34.509 INFO:teuthology.orchestra.run.smithi184.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-17T07:47:34.527 INFO:teuthology.orchestra.run.smithi184.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-17T07:47:34.528 INFO:teuthology.orchestra.run.smithi184.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-17T07:47:34.542 INFO:teuthology.orchestra.run.smithi184.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-17T07:47:34.542 INFO:teuthology.orchestra.run.smithi184.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-17T07:47:34.542 INFO:teuthology.orchestra.run.smithi184.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-17T07:47:34.592 INFO:teuthology.orchestra.run.smithi184.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-17T07:47:34.593 INFO:teuthology.orchestra.run.smithi184.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-17T07:47:34.593 INFO:teuthology.orchestra.run.smithi184.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-17T07:47:34.594 INFO:teuthology.orchestra.run.smithi184.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-17T07:47:34.595 INFO:teuthology.orchestra.run.smithi184.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-17T07:47:34.596 INFO:teuthology.orchestra.run.smithi184.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-17T07:47:34.597 INFO:teuthology.orchestra.run.smithi184.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-17T07:47:34.601 INFO:teuthology.orchestra.run.smithi184.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-17T07:47:34.608 INFO:teuthology.orchestra.run.smithi184.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-17T07:47:34.620 INFO:teuthology.orchestra.run.smithi184.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-17T07:47:34.622 INFO:teuthology.orchestra.run.smithi184.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-17T07:47:34.626 INFO:teuthology.orchestra.run.smithi184.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-17T07:47:34.630 INFO:teuthology.orchestra.run.smithi184.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-17T07:47:34.646 INFO:teuthology.orchestra.run.smithi184.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-17T07:47:34.649 INFO:teuthology.orchestra.run.smithi184.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-17T07:47:34.687 INFO:teuthology.orchestra.run.smithi184.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-17T07:47:34.688 INFO:teuthology.orchestra.run.smithi184.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-17T07:47:34.689 INFO:teuthology.orchestra.run.smithi184.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-17T07:47:34.689 INFO:teuthology.orchestra.run.smithi184.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-17T07:47:34.690 INFO:teuthology.orchestra.run.smithi184.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-17T07:47:34.691 INFO:teuthology.orchestra.run.smithi184.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-17T07:47:34.702 INFO:teuthology.orchestra.run.smithi184.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T07:47:34.703 INFO:teuthology.orchestra.run.smithi184.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-17T07:47:34.703 INFO:teuthology.orchestra.run.smithi184.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-17T07:47:34.705 INFO:teuthology.orchestra.run.smithi184.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-17T07:47:34.722 INFO:teuthology.orchestra.run.smithi184.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-17T07:47:34.722 INFO:teuthology.orchestra.run.smithi184.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-17T07:47:34.723 INFO:teuthology.orchestra.run.smithi184.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-17T07:47:34.725 INFO:teuthology.orchestra.run.smithi184.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-17T07:47:34.726 INFO:teuthology.orchestra.run.smithi184.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-17T07:47:34.809 INFO:teuthology.orchestra.run.smithi184.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1643-gd75f2382-1focal [3,564 kB] 2024-09-17T07:47:35.033 INFO:teuthology.orchestra.run.smithi184.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1643-gd75f2382-1focal [761 kB] 2024-09-17T07:47:35.058 INFO:teuthology.orchestra.run.smithi184.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1643-gd75f2382-1focal [414 kB] 2024-09-17T07:47:35.078 INFO:teuthology.orchestra.run.smithi184.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1643-gd75f2382-1focal [22.6 kB] 2024-09-17T07:47:35.087 INFO:teuthology.orchestra.run.smithi184.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1643-gd75f2382-1focal [200 kB] 2024-09-17T07:47:35.127 INFO:teuthology.orchestra.run.smithi184.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1643-gd75f2382-1focal [49.1 kB] 2024-09-17T07:47:35.155 INFO:teuthology.orchestra.run.smithi184.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1643-gd75f2382-1focal [389 kB] 2024-09-17T07:47:35.174 INFO:teuthology.orchestra.run.smithi184.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1643-gd75f2382-1focal [5,637 kB] 2024-09-17T07:47:35.355 INFO:teuthology.orchestra.run.smithi184.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1643-gd75f2382-1focal [116 kB] 2024-09-17T07:47:35.356 INFO:teuthology.orchestra.run.smithi184.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1643-gd75f2382-1focal [479 kB] 2024-09-17T07:47:35.374 INFO:teuthology.orchestra.run.smithi184.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1643-gd75f2382-1focal [27.0 MB] 2024-09-17T07:47:36.206 INFO:teuthology.orchestra.run.smithi184.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1643-gd75f2382-1focal [5,178 kB] 2024-09-17T07:47:36.409 INFO:teuthology.orchestra.run.smithi184.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1643-gd75f2382-1focal [223 kB] 2024-09-17T07:47:36.453 INFO:teuthology.orchestra.run.smithi184.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1643-gd75f2382-1focal [157 kB] 2024-09-17T07:47:36.456 INFO:teuthology.orchestra.run.smithi184.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1643-gd75f2382-1focal [1,594 kB] 2024-09-17T07:47:36.492 INFO:teuthology.orchestra.run.smithi184.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1643-gd75f2382-1focal [4,684 kB] 2024-09-17T07:47:36.601 INFO:teuthology.orchestra.run.smithi184.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1643-gd75f2382-1focal [23.1 MB] 2024-09-17T07:47:37.358 INFO:teuthology.orchestra.run.smithi184.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1643-gd75f2382-1focal [3,940 B] 2024-09-17T07:47:37.359 INFO:teuthology.orchestra.run.smithi184.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1643-gd75f2382-1focal [871 kB] 2024-09-17T07:47:37.371 INFO:teuthology.orchestra.run.smithi184.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1643-gd75f2382-1focal [2,418 kB] 2024-09-17T07:47:37.413 INFO:teuthology.orchestra.run.smithi184.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1643-gd75f2382-1focal [81.4 kB] 2024-09-17T07:47:37.414 INFO:teuthology.orchestra.run.smithi184.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1643-gd75f2382-1focal [120 kB] 2024-09-17T07:47:37.416 INFO:teuthology.orchestra.run.smithi184.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1643-gd75f2382-1focal [6,653 kB] 2024-09-17T07:47:37.640 INFO:teuthology.orchestra.run.smithi184.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1643-gd75f2382-1focal [7,885 kB] 2024-09-17T07:47:37.862 INFO:teuthology.orchestra.run.smithi184.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1643-gd75f2382-1focal [4,064 B] 2024-09-17T07:47:37.863 INFO:teuthology.orchestra.run.smithi184.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1643-gd75f2382-1focal [53.4 MB] 2024-09-17T07:47:40.050 INFO:teuthology.orchestra.run.smithi184.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1643-gd75f2382-1focal [231 kB] 2024-09-17T07:47:40.055 INFO:teuthology.orchestra.run.smithi184.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1643-gd75f2382-1focal [21.9 kB] 2024-09-17T07:47:40.055 INFO:teuthology.orchestra.run.smithi184.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1643-gd75f2382-1focal [17.2 MB] 2024-09-17T07:47:41.004 INFO:teuthology.orchestra.run.smithi184.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1643-gd75f2382-1focal [80.7 kB] 2024-09-17T07:47:41.649 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 201 MB in 7s (29.0 MB/s) 2024-09-17T07:47:41.816 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-17T07:47:41.876 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-17T07:47:41.877 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-17T07:47:41.965 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-17T07:47:42.352 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../001-librbd1_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:42.469 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librbd1 (17.2.7-1643-gd75f2382-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-17T07:47:43.121 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../002-librados2_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:43.264 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librados2 (17.2.7-1643-gd75f2382-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-17T07:47:43.935 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T07:47:43.952 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../003-libcephfs2_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:43.993 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:44.312 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rados. 2024-09-17T07:47:44.328 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../004-python3-rados_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:44.362 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rados (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:44.740 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T07:47:44.756 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:47:44.815 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-argparse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:45.067 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T07:47:45.083 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../006-python3-cephfs_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:45.133 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cephfs (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:45.495 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T07:47:45.512 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:47:45.552 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:45.906 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T07:47:45.921 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2024-09-17T07:47:45.955 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-17T07:47:46.200 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T07:47:46.216 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../009-python3-rbd_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:46.283 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rbd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:46.619 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-17T07:47:46.638 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-17T07:47:46.677 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-17T07:47:47.055 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-17T07:47:47.072 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-17T07:47:47.113 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-17T07:47:47.458 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T07:47:47.475 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-17T07:47:47.516 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-17T07:47:47.919 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T07:47:47.936 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-17T07:47:47.977 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-17T07:47:48.288 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T07:47:48.307 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-17T07:47:48.371 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-17T07:47:48.775 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T07:47:48.792 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-17T07:47:48.876 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-17T07:47:49.420 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T07:47:49.436 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-17T07:47:49.478 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-17T07:47:49.831 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T07:47:49.848 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-17T07:47:49.905 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-17T07:47:50.242 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-17T07:47:50.260 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-17T07:47:50.309 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-17T07:47:50.686 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librgw2. 2024-09-17T07:47:50.702 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../019-librgw2_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:50.744 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librgw2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:51.539 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T07:47:51.558 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../020-python3-rgw_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:51.597 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:52.225 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liboath0. 2024-09-17T07:47:52.241 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-17T07:47:52.283 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-17T07:47:52.602 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T07:47:52.620 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../022-libradosstriper1_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:52.661 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libradosstriper1 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:53.139 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-common. 2024-09-17T07:47:53.154 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../023-ceph-common_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:53.197 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:55.736 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-base. 2024-09-17T07:47:55.752 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../024-ceph-base_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:47:55.804 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-base (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:56.732 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cryptography. 2024-09-17T07:47:56.751 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-17T07:47:56.790 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-17T07:47:57.177 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T07:47:57.193 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-17T07:47:57.251 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-17T07:47:57.571 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-packaging. 2024-09-17T07:47:57.588 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../027-python3-packaging_20.3-1_all.deb ... 2024-09-17T07:47:57.629 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-17T07:47:57.906 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T07:47:57.924 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../028-ceph-mgr-modules-core_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:47:57.965 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:47:58.345 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T07:47:58.363 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../029-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-17T07:47:58.403 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-17T07:47:58.705 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T07:47:58.722 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../030-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-17T07:47:58.789 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-17T07:47:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T07:47:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../031-python3-natsort_7.0.1-1_all.deb ... 2024-09-17T07:47:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-17T07:47:59.503 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jwt. 2024-09-17T07:47:59.523 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../032-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-17T07:47:59.562 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-17T07:47:59.906 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T07:47:59.922 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-7_all.deb ... 2024-09-17T07:47:59.964 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-17T07:48:00.267 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T07:48:00.284 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../034-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-17T07:48:00.325 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-17T07:48:00.662 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-mako. 2024-09-17T07:48:00.680 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../035-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-17T07:48:00.720 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-17T07:48:01.081 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T07:48:01.097 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T07:48:01.139 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T07:48:01.459 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T07:48:01.475 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-17T07:48:01.520 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-17T07:48:01.803 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webob. 2024-09-17T07:48:01.819 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../038-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-17T07:48:01.861 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-17T07:48:02.206 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-17T07:48:02.224 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../039-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-17T07:48:02.306 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-17T07:48:02.625 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bs4. 2024-09-17T07:48:02.644 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../040-python3-bs4_4.8.2-1_all.deb ... 2024-09-17T07:48:02.684 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-17T07:48:03.066 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T07:48:03.086 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../041-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-17T07:48:03.127 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-17T07:48:03.498 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T07:48:03.518 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6_all.deb ... 2024-09-17T07:48:03.561 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-17T07:48:03.847 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-paste. 2024-09-17T07:48:03.867 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../043-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-17T07:48:03.905 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-17T07:48:04.267 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T07:48:04.283 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-17T07:48:04.325 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-17T07:48:04.636 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T07:48:04.655 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-17T07:48:04.694 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-17T07:48:04.997 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T07:48:05.016 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../046-python3-webtest_2.0.32-2_all.deb ... 2024-09-17T07:48:05.055 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-17T07:48:05.342 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T07:48:05.361 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-17T07:48:05.400 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-17T07:48:05.755 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T07:48:05.775 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../048-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-17T07:48:05.813 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-17T07:48:06.203 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T07:48:06.221 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../049-libsqlite3-mod-ceph_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:06.261 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:06.614 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T07:48:06.634 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../050-ceph-mgr_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:06.697 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:07.224 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T07:48:07.241 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../051-ceph-mon_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:07.282 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mon (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:08.636 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T07:48:08.655 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../052-ceph-osd_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:08.694 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-osd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:10.813 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph. 2024-09-17T07:48:10.834 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../053-ceph_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:10.897 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:11.216 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T07:48:11.233 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../054-ceph-fuse_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:11.274 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:11.736 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T07:48:11.752 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../055-ceph-mds_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:11.794 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mds (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:12.330 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephadm. 2024-09-17T07:48:12.346 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../056-cephadm_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:12.388 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:12.733 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T07:48:12.749 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../057-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-17T07:48:12.791 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-17T07:48:13.104 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T07:48:13.123 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../058-ceph-mgr-cephadm_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:48:13.153 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:13.565 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T07:48:13.583 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T07:48:13.623 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T07:48:13.884 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-underscore. 2024-09-17T07:48:13.903 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-17T07:48:13.942 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-17T07:48:14.253 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-17T07:48:14.269 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-17T07:48:14.311 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-17T07:48:14.672 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-routes. 2024-09-17T07:48:14.689 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2024-09-17T07:48:14.730 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-17T07:48:15.081 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T07:48:15.100 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:48:15.141 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:16.497 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-decorator. 2024-09-17T07:48:16.513 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-17T07:48:16.555 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-17T07:48:16.833 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-17T07:48:16.849 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-17T07:48:16.882 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-17T07:48:17.220 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-scipy. 2024-09-17T07:48:17.235 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-17T07:48:17.278 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-17T07:48:18.628 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-17T07:48:18.648 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-17T07:48:18.686 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-17T07:48:19.248 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T07:48:19.267 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2024-09-17T07:48:19.339 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-17T07:48:19.735 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T07:48:19.750 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-17T07:48:19.792 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-17T07:48:20.551 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T07:48:20.568 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:48:20.609 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:21.745 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T07:48:21.761 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2024-09-17T07:48:21.811 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-17T07:48:22.139 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T07:48:22.156 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-17T07:48:22.197 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-17T07:48:22.542 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T07:48:22.560 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-17T07:48:22.600 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-17T07:48:22.928 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T07:48:22.945 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2024-09-17T07:48:22.986 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-17T07:48:23.314 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T07:48:23.332 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2024-09-17T07:48:23.372 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-17T07:48:24.059 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-blinker. 2024-09-17T07:48:24.079 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-17T07:48:24.142 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-17T07:48:24.454 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-17T07:48:24.472 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-17T07:48:24.512 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-17T07:48:24.873 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T07:48:24.889 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-17T07:48:24.931 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-17T07:48:25.268 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T07:48:25.285 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-17T07:48:25.325 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-17T07:48:25.668 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T07:48:25.687 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-17T07:48:25.729 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-17T07:48:26.347 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T07:48:26.364 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:48:26.406 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:26.742 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T07:48:26.762 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2024-09-17T07:48:26.792 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-17T07:48:27.153 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T07:48:27.169 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-17T07:48:27.211 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-17T07:48:27.489 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package jq. 2024-09-17T07:48:27.508 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-17T07:48:27.547 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-17T07:48:27.825 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package socat. 2024-09-17T07:48:27.843 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2024-09-17T07:48:27.883 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-17T07:48:28.188 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T07:48:28.205 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-17T07:48:28.279 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-17T07:48:28.584 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-test. 2024-09-17T07:48:28.600 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../087-ceph-test_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:28.642 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-test (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:33.391 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T07:48:33.410 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../088-ceph-volume_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-17T07:48:33.441 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-volume (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:33.828 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-17T07:48:33.848 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-17T07:48:33.886 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-17T07:48:34.392 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T07:48:34.412 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../090-libcephfs-dev_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:34.450 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs-dev (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:34.887 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T07:48:34.903 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-17T07:48:34.962 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-17T07:48:35.316 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-17T07:48:35.333 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../092-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-17T07:48:35.374 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-17T07:48:37.116 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-17T07:48:37.134 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../093-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-17T07:48:37.174 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-17T07:48:37.535 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-17T07:48:37.553 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../094-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-17T07:48:37.593 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-17T07:48:37.846 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-attr. 2024-09-17T07:48:37.867 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../095-python3-attr_19.3.0-2_all.deb ... 2024-09-17T07:48:37.895 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-17T07:48:38.241 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webencodings. 2024-09-17T07:48:38.257 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../096-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-17T07:48:38.299 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-17T07:48:38.601 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-html5lib. 2024-09-17T07:48:38.620 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../097-python3-html5lib_1.0.1-2_all.deb ... 2024-09-17T07:48:38.659 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-17T07:48:38.979 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-17T07:48:38.997 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../098-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-17T07:48:39.037 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-17T07:48:39.474 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T07:48:39.492 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T07:48:39.532 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T07:48:39.877 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T07:48:39.893 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2024-09-17T07:48:39.935 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-17T07:48:40.272 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T07:48:40.289 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-17T07:48:40.329 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-17T07:48:40.665 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-py. 2024-09-17T07:48:40.684 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-17T07:48:40.723 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-17T07:48:41.043 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T07:48:41.064 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-17T07:48:41.101 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-17T07:48:41.445 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T07:48:41.462 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-17T07:48:41.503 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-17T07:48:41.815 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T07:48:41.833 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2024-09-17T07:48:41.873 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-17T07:48:42.168 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T07:48:42.185 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-17T07:48:42.251 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-17T07:48:42.529 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T07:48:42.546 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-17T07:48:42.587 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-17T07:48:43.379 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package radosgw. 2024-09-17T07:48:43.397 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../108-radosgw_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:43.437 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking radosgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:45.233 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T07:48:45.250 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../109-rbd-fuse_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-17T07:48:45.282 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking rbd-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:45.627 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-17T07:48:45.912 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-17T07:48:46.072 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-17T07:48:46.198 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-17T07:48:46.399 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:46.963 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user cephadm....done 2024-09-17T07:48:47.150 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-17T07:48:47.276 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-17T07:48:47.619 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T07:48:47.895 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-17T07:48:48.021 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-17T07:48:48.172 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-17T07:48:48.500 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-17T07:48:48.911 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-17T07:48:49.195 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-17T07:48:49.480 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-17T07:48:49.756 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-17T07:48:50.040 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-argparse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:50.366 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-17T07:48:50.492 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-17T07:48:50.785 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-17T07:48:51.070 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-17T07:48:51.221 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-17T07:48:51.580 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-17T07:48:51.865 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-17T07:48:52.141 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-17T07:48:52.526 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-17T07:48:52.811 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-17T07:48:53.164 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-17T07:48:53.445 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-17T07:48:53.721 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-17T07:48:53.889 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-17T07:48:54.015 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-17T07:48:54.300 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-17T07:48:54.968 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-17T07:48:55.344 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-17T07:48:55.705 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-17T07:48:55.830 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:48:56.165 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-17T07:48:56.291 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-17T07:48:56.634 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-17T07:48:56.760 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-17T07:48:56.886 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-17T07:48:57.187 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-17T07:48:57.522 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-17T07:48:57.648 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-17T07:48:57.791 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-17T07:48:58.109 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-17T07:48:58.394 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-17T07:48:58.670 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-17T07:48:58.796 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T07:48:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-17T07:48:59.406 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-17T07:48:59.690 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-17T07:49:00.048 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-17T07:49:00.302 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-17T07:49:00.427 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-17T07:49:00.745 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-17T07:49:01.097 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-17T07:49:01.248 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-17T07:49:01.373 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-17T07:49:01.717 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-17T07:49:02.001 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librados2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:02.127 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-17T07:49:03.625 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:03.742 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-17T07:49:03.902 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-17T07:49:04.278 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-17T07:49:04.621 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-17T07:49:04.914 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-17T07:49:05.039 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-17T07:49:05.391 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:05.500 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-17T07:49:05.827 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libradosstriper1 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:05.987 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-17T07:49:06.304 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-17T07:49:07.352 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librbd1 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:07.504 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-17T07:49:07.628 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-17T07:49:07.754 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-17T07:49:07.880 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-17T07:49:08.207 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-17T07:49:08.341 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-17T07:49:08.626 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-modules-core (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:08.752 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:08.974 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T07:49:08.975 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T07:49:09.420 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs-dev (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:09.656 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-17T07:49:09.966 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T07:49:10.309 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-17T07:49:10.678 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rados (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:10.804 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librgw2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:10.930 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rbd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:11.056 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up rbd-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:11.216 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-17T07:49:11.509 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-17T07:49:11.811 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:11.936 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cephfs (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:12.063 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-17T07:49:13.016 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:13.593 INFO:teuthology.orchestra.run.smithi184.stdout:Adding group ceph....done 2024-09-17T07:49:13.987 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user ceph....done 2024-09-17T07:49:14.163 INFO:teuthology.orchestra.run.smithi184.stdout:Setting system user ceph properties....done 2024-09-17T07:49:14.185 INFO:teuthology.orchestra.run.smithi184.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T07:49:14.337 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T07:49:14.648 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T07:49:15.109 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-test (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:15.269 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up radosgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:15.539 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T07:49:15.539 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T07:49:16.204 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-base (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:16.612 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T07:49:17.056 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mds (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:17.273 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T07:49:17.273 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T07:49:17.716 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:17.949 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T07:49:17.949 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T07:49:18.417 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-osd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:18.910 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T07:49:18.910 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T07:49:19.365 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:19.495 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:19.637 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mon (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:19.861 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T07:49:19.861 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T07:49:20.314 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:20.733 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:20.850 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-dashboard (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:21.001 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-volume (17.2.7-1643-gd75f2382-1focal) ... 2024-09-17T07:49:21.128 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-17T07:49:21.280 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-17T07:49:21.565 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-17T07:49:24.451 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-17T07:49:25.074 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T07:49:25.080 DEBUG:teuthology.parallel:result is None 2024-09-17T07:49:25.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d75f23820806da622f561ee5ee7551015285993f 2024-09-17T07:49:25.232 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2024-09-17T07:49:25.255 INFO:teuthology.orchestra.run.smithi184.stdout:17.2.7-1643-gd75f2382-1focal 2024-09-17T07:49:25.255 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1643-gd75f2382-1focal 2024-09-17T07:49:25.256 INFO:teuthology.task.install:The correct ceph version 17.2.7-1643-gd75f2382-1focal is installed. 2024-09-17T07:49:25.257 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T07:49:25.258 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:25.258 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T07:49:25.313 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T07:49:25.313 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:25.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T07:49:25.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T07:49:25.338 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T07:49:25.338 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:25.338 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T07:49:25.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T07:49:25.406 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T07:49:25.406 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:25.406 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T07:49:25.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T07:49:25.434 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T07:49:25.518 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T07:49:25.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2024-09-17T07:49:25.534 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T07:49:25.535 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T07:49:25.596 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T07:49:25.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T07:49:25.614 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T07:49:25.614 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T07:49:25.615 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7908726', 'branch': 'wip-bharath9-testing-2024-09-13-1444-quincy', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic}', 'email': 'sangadi@redhat.com', 'first_in_suite': False, 'job_id': '7908726', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath9-testing-2024-09-13-1444-quincy'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath9-testing-2024-09-13-1444-quincy', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}}, 'owner': 'scheduled_sangadi@teuthology', 'priority': 130, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 9764, 'sha1': 'd75f23820806da622f561ee5ee7551015285993f', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-bharath9-testing-2024-09-13-1444-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd75f23820806da622f561ee5ee7551015285993f', 'targets': {'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_07:28:46', 'tube': 'smithi', 'user': 'sangadi', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T07:49:25.615 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T07:49:25.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T07:49:25.681 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:25.682 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T07:49:25.687 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T07:49:25.687 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-09-17T07:49:25.692 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T07:49:25.693 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:49:25.693 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-09-17T07:49:25.693 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:49:25.693 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-17 07:45:58.516231676 +0000 2024-09-17T07:49:25.693 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-17 07:45:58.512231769 +0000 2024-09-17T07:49:25.693 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-17 07:45:58.512231769 +0000 2024-09-17T07:49:25.693 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-09-17T07:49:25.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T07:49:25.705 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-17T07:49:25.705 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-17T07:49:25.705 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000450861 s, 1.1 MB/s 2024-09-17T07:49:25.706 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T07:49:25.757 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-09-17T07:49:25.763 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T07:49:25.764 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:49:25.764 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 376 Links: 1 2024-09-17T07:49:25.764 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:49:25.764 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-17 07:45:58.976221091 +0000 2024-09-17T07:49:25.764 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-17 07:45:58.972221184 +0000 2024-09-17T07:49:25.764 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-17 07:45:58.972221184 +0000 2024-09-17T07:49:25.764 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-09-17T07:49:25.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T07:49:25.775 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-17T07:49:25.775 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-17T07:49:25.775 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000409924 s, 1.2 MB/s 2024-09-17T07:49:25.776 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T07:49:25.783 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-17 07:45:59.600206732 +0000 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-17 07:45:59.388211610 +0000 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-17 07:45:59.388211610 +0000 2024-09-17T07:49:25.790 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-09-17T07:49:25.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T07:49:25.806 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-17T07:49:25.806 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-17T07:49:25.806 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00036943 s, 1.4 MB/s 2024-09-17T07:49:25.807 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T07:49:25.857 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 386 Links: 1 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-09-17 07:46:00.032196790 +0000 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-09-17 07:45:59.828201485 +0000 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-09-17 07:45:59.828201485 +0000 2024-09-17T07:49:25.864 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-09-17T07:49:25.865 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T07:49:25.878 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-09-17T07:49:25.879 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-09-17T07:49:25.879 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000373126 s, 1.4 MB/s 2024-09-17T07:49:25.880 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T07:49:25.930 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T07:49:25.930 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-17T07:49:25.930 INFO:tasks.ceph:Generating config... 2024-09-17T07:49:25.932 INFO:tasks.ceph:[client] rbd default format = 1 2024-09-17T07:49:25.932 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-17T07:49:25.932 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-17T07:49:25.932 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-17T07:49:25.932 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T07:49:25.932 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T07:49:25.932 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T07:49:25.932 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T07:49:25.933 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T07:49:25.933 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T07:49:25.934 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T07:49:25.934 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T07:49:25.934 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T07:49:25.934 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-17T07:49:25.934 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T07:49:25.934 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T07:49:25.966 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T07:49:25.969 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T07:49:26.047 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T07:49:26.061 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.184')] 2024-09-17T07:49:26.062 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.184', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2024-09-17T07:49:26.063 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:26.063 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T07:49:26.067 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.184 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T07:49:26.142 INFO:teuthology.orchestra.run.smithi184.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T07:49:26.142 INFO:teuthology.orchestra.run.smithi184.stdout:monmaptool: generated fsid 60881366-2a57-49f8-b8db-3c3284f0e07f 2024-09-17T07:49:26.142 INFO:teuthology.orchestra.run.smithi184.stdout:setting min_mon_release = octopus 2024-09-17T07:49:26.142 INFO:teuthology.orchestra.run.smithi184.stdout:epoch 0 2024-09-17T07:49:26.142 INFO:teuthology.orchestra.run.smithi184.stdout:fsid 60881366-2a57-49f8-b8db-3c3284f0e07f 2024-09-17T07:49:26.142 INFO:teuthology.orchestra.run.smithi184.stdout:last_changed 2024-09-17T07:49:26.146211+0000 2024-09-17T07:49:26.142 INFO:teuthology.orchestra.run.smithi184.stdout:created 2024-09-17T07:49:26.146211+0000 2024-09-17T07:49:26.143 INFO:teuthology.orchestra.run.smithi184.stdout:min_mon_release 15 (octopus) 2024-09-17T07:49:26.143 INFO:teuthology.orchestra.run.smithi184.stdout:election_strategy: 1 2024-09-17T07:49:26.143 INFO:teuthology.orchestra.run.smithi184.stdout:0: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.a 2024-09-17T07:49:26.143 INFO:teuthology.orchestra.run.smithi184.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-17T07:49:26.144 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T07:49:26.148 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 60881366-2a57-49f8-b8db-3c3284f0e07f... 2024-09-17T07:49:26.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T07:49:26.184 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-09-17T07:49:26.184 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2024-09-17T07:49:26.184 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T07:49:26.184 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T07:49:26.185 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2024-09-17T07:49:26.186 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.187 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = 172.21.15.184 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: mon client directed command retry = 5 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on pool no app = False 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject socket failures = 5000 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 60881366-2a57-49f8-b8db-3c3284f0e07f 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2024-09-17T07:49:26.188 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.189 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2024-09-17T07:49:26.190 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2024-09-17T07:49:26.190 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.190 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2024-09-17T07:49:26.190 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.190 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2024-09-17T07:49:26.190 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.191 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2024-09-17T07:49:26.191 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.191 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2024-09-17T07:49:26.191 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2024-09-17T07:49:26.191 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.191 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2024-09-17T07:49:26.192 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2024-09-17T07:49:26.192 INFO:teuthology.orchestra.run.smithi184.stdout: bdev async discard = True 2024-09-17T07:49:26.192 INFO:teuthology.orchestra.run.smithi184.stdout: bdev enable discard = True 2024-09-17T07:49:26.192 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore allocator = stupid 2024-09-17T07:49:26.192 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2024-09-17T07:49:26.192 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 1/20 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 1/20 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 4/10 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2024-09-17T07:49:26.193 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout: osd shutdown pgref assert = True 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2024-09-17T07:49:26.194 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-09-17T07:49:26.195 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-09-17T07:49:26.195 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-09-17T07:49:26.195 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-09-17T07:49:26.195 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2024-09-17T07:49:26.195 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.195 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2024-09-17T07:49:26.196 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-09-17T07:49:26.196 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-09-17T07:49:26.196 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2024-09-17T07:49:26.196 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-09-17T07:49:26.196 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2024-09-17T07:49:26.196 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2024-09-17T07:49:26.196 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-09-17T07:49:26.197 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2024-09-17T07:49:26.197 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2024-09-17T07:49:26.197 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-09-17T07:49:26.197 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.197 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T07:49:26.197 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2024-09-17T07:49:26.198 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout: rbd default format = 1 2024-09-17T07:49:26.199 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2024-09-17T07:49:26.200 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T07:49:26.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T07:49:26.291 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T07:49:26.291 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:26.291 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T07:49:26.298 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:26.298 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T07:49:26.304 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T07:49:26.305 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:26.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T07:49:26.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T07:49:26.325 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:26.326 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T07:49:26.331 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T07:49:26.331 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T07:49:26.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T07:49:26.370 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T07:49:26.372 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T07:49:26.373 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T07:49:26.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T07:49:26.450 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T07:49:26.462 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T07:49:26.462 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-17T07:49:26.463 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T07:49:26.479 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T07:49:26.479 INFO:tasks.ceph:role: osd.0 2024-09-17T07:49:26.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T07:49:26.479 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T07:49:27.039 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T07:49:27.039 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T07:49:27.040 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T07:49:27.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-09-17T07:49:27.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T07:49:27.125 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T07:49:27.137 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T07:49:27.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:49:27.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T07:49:27.149 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T07:49:27.150 INFO:tasks.ceph:role: osd.1 2024-09-17T07:49:27.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T07:49:27.150 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T07:49:27.688 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T07:49:27.689 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T07:49:27.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-09-17T07:49:27.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T07:49:27.720 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T07:49:27.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:49:27.731 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T07:49:27.731 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T07:49:27.789 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T07:49:27.789 INFO:tasks.ceph:role: osd.2 2024-09-17T07:49:27.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T07:49:27.790 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T07:49:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T07:49:28.271 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-09-17T07:49:28.271 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T07:49:28.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T07:49:28.340 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T07:49:28.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:49:28.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T07:49:28.415 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:28.415+0000 7f7c56d6b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T07:49:28.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:28.419+0000 7f7c56d6b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T07:49:28.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:28.419+0000 7f7c56d6b540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-17T07:49:28.418 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:28.419+0000 7f7c56d6b540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-17T07:49:28.418 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:28.419+0000 7f7c56d6b540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-17T07:49:28.418 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:28.419+0000 7f7c56d6b540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T07:49:28.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:28.975+0000 7f7c56d6b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:29.769 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:29.767+0000 7f7c56d6b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:30.547 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:30.547+0000 7f7c56d6b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:31.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T07:49:31.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T07:49:31.446 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:31.447+0000 7f537d358540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T07:49:31.446 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:31.447+0000 7f537d358540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T07:49:31.447 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:31.447+0000 7f537d358540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-17T07:49:31.447 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:31.447+0000 7f537d358540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-17T07:49:31.447 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:31.447+0000 7f537d358540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-17T07:49:31.447 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:31.447+0000 7f537d358540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T07:49:32.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:32.007+0000 7f537d358540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:32.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:32.791+0000 7f537d358540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:33.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:33.571+0000 7f537d358540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:34.417 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T07:49:34.477 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T07:49:34.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:34.515+0000 7f9f42625540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T07:49:34.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:34.515+0000 7f9f42625540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T07:49:34.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:34.515+0000 7f9f42625540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-17T07:49:34.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:34.515+0000 7f9f42625540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-17T07:49:34.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:34.515+0000 7f9f42625540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-17T07:49:34.515 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:34.515+0000 7f9f42625540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T07:49:35.076 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:35.075+0000 7f9f42625540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:35.858 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:35.859+0000 7f9f42625540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:36.644 INFO:teuthology.orchestra.run.smithi184.stderr:2024-09-17T07:49:36.643+0000 7f9f42625540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-17T07:49:37.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T07:49:37.505 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T07:49:37.505 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:37.505 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T07:49:37.563 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:37.563 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T07:49:37.578 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:37.578 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T07:49:37.588 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:37.588 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T07:49:37.600 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:37.600 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T07:49:37.647 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T07:49:37.647 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCGNOlmGI1SFhAAjRMAy/JI6v9iOl80kGIbQg== 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCINOlmyqECGRAAZozBPNrsOXMuB1muvLSrnA== 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCLNOlmsDTcGhAAKd5vUGvpBdcGl/ZciaA/Og== 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2024-09-17T07:49:37.662 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCONOlmEqPrHhAA24OhXPDDnECCBnWYk6fkOg== 2024-09-17T07:49:37.663 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-09-17T07:49:37.663 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCGNOlmr7AUGxAATjw7YicUJYkXjdbdBLuLpQ== 2024-09-17T07:49:37.663 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T07:49:37.704 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T07:49:37.746 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T07:49:37.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T07:49:37.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T07:49:37.917 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T07:49:37.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T07:49:37.930 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T07:49:38.027 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T07:49:38.039 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T07:49:38.045 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T07:49:38.045 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T07:49:38.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T07:49:38.047 INFO:tasks.ceph.mon.a:Started 2024-09-17T07:49:38.047 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T07:49:38.047 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T07:49:38.047 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T07:49:38.050 INFO:tasks.ceph.mgr.x:Started 2024-09-17T07:49:38.050 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T07:49:38.050 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T07:49:38.275 INFO:teuthology.orchestra.run.smithi184.stderr:adjusted tunables profile to default 2024-09-17T07:49:38.286 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T07:49:38.286 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:38.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T07:49:38.296 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:38.296 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T07:49:38.307 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:49:38.307 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T07:49:38.322 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 23d0ff8a-1923-4c3e-9c72-968848969523 0 2024-09-17T07:49:38.364 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:38.363+0000 7f11e9f5a000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T07:49:38.510 INFO:teuthology.orchestra.run.smithi184.stdout:0 2024-09-17T07:49:38.523 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c 1 2024-09-17T07:49:38.719 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-09-17T07:49:38.731 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 74335336-a05f-4125-b9fc-aeda243d4046 2 2024-09-17T07:49:38.928 INFO:teuthology.orchestra.run.smithi184.stdout:2 2024-09-17T07:49:38.940 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T07:49:38.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T07:49:38.942 INFO:tasks.ceph.osd.0:Started 2024-09-17T07:49:38.943 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T07:49:38.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T07:49:38.945 INFO:tasks.ceph.osd.1:Started 2024-09-17T07:49:38.945 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T07:49:38.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T07:49:38.947 INFO:tasks.ceph.osd.2:Started 2024-09-17T07:49:38.947 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T07:49:39.122 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.123+0000 7f11e9f5a000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T07:49:39.132 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:39.133 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":5,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T07:49:38.930014+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:49:39.145 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T07:49:39.145 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T07:49:39.179 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.179+0000 7f11e9f5a000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T07:49:39.295 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.295+0000 7f11e9f5a000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T07:49:39.447 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T07:49:39.535 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.535+0000 7f11e9f5a000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T07:49:39.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:49:39.555+0000 7f9d1a820540 -1 Falling back to public interface 2024-09-17T07:49:39.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:49:39.559+0000 7fdbc463e540 -1 Falling back to public interface 2024-09-17T07:49:39.559 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-09-17T07:49:39.559+0000 7f90e7025540 -1 Falling back to public interface 2024-09-17T07:49:39.591 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.591+0000 7f11e9f5a000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T07:49:39.750 INFO:teuthology.misc.health.smithi184.stderr:2024-09-17T07:49:39.751+0000 7f4d918e5700 0 --2- 172.21.15.184:0/4285502503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d78003a60 0x7f4d8c126fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T07:49:39.783 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.783+0000 7f11e9f5a000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T07:49:39.824 INFO:teuthology.misc.health.smithi184.stdout: 2024-09-17T07:49:39.824 INFO:teuthology.misc.health.smithi184.stdout:{"epoch":5,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T07:49:38.930014+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:49:39.835 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-17T07:49:39.850 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.851+0000 7f11e9f5a000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T07:49:39.917 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:39.915+0000 7f11e9f5a000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T07:49:40.382 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:40.383+0000 7f11e9f5a000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T07:49:40.500 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:40.499+0000 7f11e9f5a000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T07:49:40.807 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:40.807+0000 7f11e9f5a000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T07:49:40.970 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:40.971+0000 7f11e9f5a000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T07:49:41.036 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.035+0000 7f11e9f5a000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T07:49:41.084 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.083+0000 7f11e9f5a000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T07:49:41.136 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.135+0000 7f11e9f5a000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T07:49:41.291 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.291+0000 7f11e9f5a000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T07:49:41.459 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.459+0000 7f11e9f5a000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T07:49:41.524 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.523+0000 7f11e9f5a000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T07:49:41.682 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.683+0000 7f11e9f5a000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T07:49:41.745 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:41.743+0000 7f11e9f5a000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T07:49:42.491 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:42.491+0000 7f11e9f5a000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T07:49:43.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:49:43.143+0000 7f9d1a820540 -1 osd.1 0 log_to_monitors true 2024-09-17T07:49:43.346 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-09-17T07:49:43.347+0000 7f90e7025540 -1 osd.2 0 log_to_monitors true 2024-09-17T07:49:43.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:49:43.371+0000 7fdbc463e540 -1 osd.0 0 log_to_monitors true 2024-09-17T07:49:43.525 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-09-17T07:49:43.523+0000 7f11d2fce700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-17T07:49:46.138 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T07:49:46.522 INFO:teuthology.misc.health.smithi184.stdout: 2024-09-17T07:49:46.522 INFO:teuthology.misc.health.smithi184.stdout:{"epoch":7,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T07:49:44.574714+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:49:46.538 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-17T07:49:46.663 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-09-17T07:49:46.663+0000 7f90e3fea700 -1 osd.2 0 waiting for initial osdmap 2024-09-17T07:49:46.673 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-09-17T07:49:46.675+0000 7f90db568700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:49:46.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:49:46.675+0000 7fdbbfdde700 -1 osd.0 0 waiting for initial osdmap 2024-09-17T07:49:46.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:49:46.683+0000 7fdbb8b81700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:49:46.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:49:46.715+0000 7f9d177e5700 -1 osd.1 0 waiting for initial osdmap 2024-09-17T07:49:46.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:49:46.723+0000 7f9d0ed63700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T07:49:52.841 DEBUG:teuthology.orchestra.run.smithi184:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T07:49:53.124 INFO:teuthology.misc.health.smithi184.stdout: 2024-09-17T07:49:53.124 INFO:teuthology.misc.health.smithi184.stdout:{"epoch":11,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T07:49:50.695957+0000","last_up_change":"2024-09-17T07:49:47.682068+0000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:49:48.588254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":21058},{"type":"v1","addr":"172.21.15.184:6811","nonce":21058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":21058},{"type":"v1","addr":"172.21.15.184:6815","nonce":21058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":21058},{"type":"v1","addr":"172.21.15.184:6823","nonce":21058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":21058},{"type":"v1","addr":"172.21.15.184:6819","nonce":21058}]},"public_addr":"172.21.15.184:6811/21058","cluster_addr":"172.21.15.184:6815/21058","heartbeat_back_addr":"172.21.15.184:6823/21058","heartbeat_front_addr":"172.21.15.184:6819/21058","state":["exists","up"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":21060},{"type":"v1","addr":"172.21.15.184:6801","nonce":21060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":21060},{"type":"v1","addr":"172.21.15.184:6803","nonce":21060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":21060},{"type":"v1","addr":"172.21.15.184:6807","nonce":21060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":21060},{"type":"v1","addr":"172.21.15.184:6805","nonce":21060}]},"public_addr":"172.21.15.184:6801/21060","cluster_addr":"172.21.15.184:6803/21060","heartbeat_back_addr":"172.21.15.184:6807/21060","heartbeat_front_addr":"172.21.15.184:6805/21060","state":["exists","up"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":21059},{"type":"v1","addr":"172.21.15.184:6810","nonce":21059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":21059},{"type":"v1","addr":"172.21.15.184:6814","nonce":21059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":21059},{"type":"v1","addr":"172.21.15.184:6822","nonce":21059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":21059},{"type":"v1","addr":"172.21.15.184:6818","nonce":21059}]},"public_addr":"172.21.15.184:6810/21059","cluster_addr":"172.21.15.184:6814/21059","heartbeat_back_addr":"172.21.15.184:6822/21059","heartbeat_front_addr":"172.21.15.184:6818/21059","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.414580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.122470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.363916+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:49:53.137 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-17T07:49:53.138 INFO:tasks.ceph:Creating RBD pool 2024-09-17T07:49:53.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-17T07:49:53.722 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'rbd' created 2024-09-17T07:49:53.736 DEBUG:teuthology.orchestra.run.smithi184:> rbd --cluster ceph pool init rbd 2024-09-17T07:49:56.747 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T07:49:56.747 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T07:49:56.748 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T07:49:56.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T07:49:56.748 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T07:49:57.088 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:57.101 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":20875},{"type":"v1","addr":"172.21.15.184:6825","nonce":20875}]},"active_addr":"172.21.15.184:6825/20875","active_change":"2024-09-17T07:49:42.515548+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":2743254311}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":401828811}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1402896489}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":3112964292}]}]} 2024-09-17T07:49:57.105 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T07:49:57.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T07:49:57.105 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T07:49:57.390 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:57.390 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":15,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T07:49:56.730540+0000","last_up_change":"2024-09-17T07:49:47.682068+0000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:49:48.588254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T07:49:53.457478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":21058},{"type":"v1","addr":"172.21.15.184:6811","nonce":21058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":21058},{"type":"v1","addr":"172.21.15.184:6815","nonce":21058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":21058},{"type":"v1","addr":"172.21.15.184:6823","nonce":21058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":21058},{"type":"v1","addr":"172.21.15.184:6819","nonce":21058}]},"public_addr":"172.21.15.184:6811/21058","cluster_addr":"172.21.15.184:6815/21058","heartbeat_back_addr":"172.21.15.184:6823/21058","heartbeat_front_addr":"172.21.15.184:6819/21058","state":["exists","up"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":21060},{"type":"v1","addr":"172.21.15.184:6801","nonce":21060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":21060},{"type":"v1","addr":"172.21.15.184:6803","nonce":21060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":21060},{"type":"v1","addr":"172.21.15.184:6807","nonce":21060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":21060},{"type":"v1","addr":"172.21.15.184:6805","nonce":21060}]},"public_addr":"172.21.15.184:6801/21060","cluster_addr":"172.21.15.184:6803/21060","heartbeat_back_addr":"172.21.15.184:6807/21060","heartbeat_front_addr":"172.21.15.184:6805/21060","state":["exists","up"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":21059},{"type":"v1","addr":"172.21.15.184:6810","nonce":21059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":21059},{"type":"v1","addr":"172.21.15.184:6814","nonce":21059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":21059},{"type":"v1","addr":"172.21.15.184:6822","nonce":21059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":21059},{"type":"v1","addr":"172.21.15.184:6818","nonce":21059}]},"public_addr":"172.21.15.184:6810/21059","cluster_addr":"172.21.15.184:6814/21059","heartbeat_back_addr":"172.21.15.184:6822/21059","heartbeat_front_addr":"172.21.15.184:6818/21059","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.414580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.122470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.363916+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:49:57.404 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T07:49:57.404 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T07:49:57.687 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:57.687 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":15,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T07:49:56.730540+0000","last_up_change":"2024-09-17T07:49:47.682068+0000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:49:48.588254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T07:49:53.457478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":21058},{"type":"v1","addr":"172.21.15.184:6811","nonce":21058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":21058},{"type":"v1","addr":"172.21.15.184:6815","nonce":21058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":21058},{"type":"v1","addr":"172.21.15.184:6823","nonce":21058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":21058},{"type":"v1","addr":"172.21.15.184:6819","nonce":21058}]},"public_addr":"172.21.15.184:6811/21058","cluster_addr":"172.21.15.184:6815/21058","heartbeat_back_addr":"172.21.15.184:6823/21058","heartbeat_front_addr":"172.21.15.184:6819/21058","state":["exists","up"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":21060},{"type":"v1","addr":"172.21.15.184:6801","nonce":21060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":21060},{"type":"v1","addr":"172.21.15.184:6803","nonce":21060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":21060},{"type":"v1","addr":"172.21.15.184:6807","nonce":21060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":21060},{"type":"v1","addr":"172.21.15.184:6805","nonce":21060}]},"public_addr":"172.21.15.184:6801/21060","cluster_addr":"172.21.15.184:6803/21060","heartbeat_back_addr":"172.21.15.184:6807/21060","heartbeat_front_addr":"172.21.15.184:6805/21060","state":["exists","up"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":21059},{"type":"v1","addr":"172.21.15.184:6810","nonce":21059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":21059},{"type":"v1","addr":"172.21.15.184:6814","nonce":21059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":21059},{"type":"v1","addr":"172.21.15.184:6822","nonce":21059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":21059},{"type":"v1","addr":"172.21.15.184:6818","nonce":21059}]},"public_addr":"172.21.15.184:6810/21059","cluster_addr":"172.21.15.184:6814/21059","heartbeat_back_addr":"172.21.15.184:6822/21059","heartbeat_front_addr":"172.21.15.184:6818/21059","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.414580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.122470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.363916+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T07:49:57.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T07:49:57.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T07:49:57.702 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T07:49:57.836 INFO:teuthology.orchestra.run.smithi184.stdout:34359738372 2024-09-17T07:49:57.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T07:49:57.837 INFO:teuthology.orchestra.run.smithi184.stdout:34359738374 2024-09-17T07:49:57.837 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T07:49:57.838 INFO:teuthology.orchestra.run.smithi184.stdout:34359738374 2024-09-17T07:49:57.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T07:49:58.105 INFO:teuthology.orchestra.run.smithi184.stdout:34359738373 2024-09-17T07:49:58.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2024-09-17T07:49:58.118 INFO:teuthology.orchestra.run.smithi184.stdout:34359738373 2024-09-17T07:49:58.131 INFO:teuthology.orchestra.run.smithi184.stdout:34359738371 2024-09-17T07:49:58.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-09-17T07:49:58.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2024-09-17T07:49:59.118 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T07:49:59.133 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T07:49:59.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T07:49:59.426 INFO:teuthology.orchestra.run.smithi184.stdout:34359738374 2024-09-17T07:49:59.426 INFO:teuthology.orchestra.run.smithi184.stdout:34359738374 2024-09-17T07:49:59.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-17T07:49:59.441 DEBUG:teuthology.parallel:result is None 2024-09-17T07:49:59.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2024-09-17T07:49:59.444 DEBUG:teuthology.parallel:result is None 2024-09-17T07:49:59.469 INFO:teuthology.orchestra.run.smithi184.stdout:34359738372 2024-09-17T07:49:59.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.2 2024-09-17T07:49:59.483 DEBUG:teuthology.parallel:result is None 2024-09-17T07:49:59.483 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T07:49:59.483 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T07:49:59.767 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:49:59.771 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T07:49:59.781 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-17T07:49:58.525175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":893628,"kb_used_data":1540,"kb_used_omap":4,"kb_used_meta":892027,"kb_avail":282221892,"statfs":{"total":289910292480,"available":288995217408,"internally_reserved":0,"allocated":1576960,"data_stored":1290988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":913435656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.807610"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.747331+0000","last_change":"2024-09-17T07:49:56.747739+0000","last_active":"2024-09-17T07:49:56.747331+0000","last_peered":"2024-09-17T07:49:56.747331+0000","last_clean":"2024-09-17T07:49:56.747331+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T07:49:56.747331+0000","last_undegraded":"2024-09-17T07:49:56.747331+0000","last_fullsized":"2024-09-17T07:49:56.747331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014763790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.747176+0000","last_change":"2024-09-17T07:49:56.747442+0000","last_active":"2024-09-17T07:49:56.747176+0000","last_peered":"2024-09-17T07:49:56.747176+0000","last_clean":"2024-09-17T07:49:56.747176+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T07:49:56.747176+0000","last_undegraded":"2024-09-17T07:49:56.747176+0000","last_fullsized":"2024-09-17T07:49:56.747176+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001292358,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.746580+0000","last_change":"2024-09-17T07:49:56.747006+0000","last_active":"2024-09-17T07:49:56.746580+0000","last_peered":"2024-09-17T07:49:56.746580+0000","last_clean":"2024-09-17T07:49:56.746580+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T07:49:56.746580+0000","last_undegraded":"2024-09-17T07:49:56.746580+0000","last_fullsized":"2024-09-17T07:49:56.746580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090165199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.745994+0000","last_change":"2024-09-17T07:49:56.746303+0000","last_active":"2024-09-17T07:49:56.745994+0000","last_peered":"2024-09-17T07:49:56.745994+0000","last_clean":"2024-09-17T07:49:56.745994+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T07:49:56.745994+0000","last_undegraded":"2024-09-17T07:49:56.745994+0000","last_fullsized":"2024-09-17T07:49:56.745994+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000749937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.740099+0000","last_change":"2024-09-17T07:49:56.740099+0000","last_active":"2024-09-17T07:49:56.740099+0000","last_peered":"2024-09-17T07:49:56.740099+0000","last_clean":"2024-09-17T07:49:56.740099+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T07:49:56.740099+0000","last_undegraded":"2024-09-17T07:49:56.740099+0000","last_fullsized":"2024-09-17T07:49:56.740099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074672400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:57.550434+0000","last_change":"2024-09-17T07:49:57.550747+0000","last_active":"2024-09-17T07:49:57.550434+0000","last_peered":"2024-09-17T07:49:57.550434+0000","last_clean":"2024-09-17T07:49:57.550434+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T07:49:57.550434+0000","last_undegraded":"2024-09-17T07:49:57.550434+0000","last_fullsized":"2024-09-17T07:49:57.550434+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:13.546583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057517600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:57.550308+0000","last_change":"2024-09-17T07:49:57.550683+0000","last_active":"2024-09-17T07:49:57.550308+0000","last_peered":"2024-09-17T07:49:57.550308+0000","last_clean":"2024-09-17T07:49:57.550308+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T07:49:57.550308+0000","last_undegraded":"2024-09-17T07:49:57.550308+0000","last_fullsized":"2024-09-17T07:49:57.550308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:58.525227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057602900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.746439+0000","last_change":"2024-09-17T07:49:56.746889+0000","last_active":"2024-09-17T07:49:56.746439+0000","last_peered":"2024-09-17T07:49:56.746439+0000","last_clean":"2024-09-17T07:49:56.746439+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T07:49:56.746439+0000","last_undegraded":"2024-09-17T07:49:56.746439+0000","last_fullsized":"2024-09-17T07:49:56.746439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010646710000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'52","reported_seq":80,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-17T07:49:55.740145+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T07:49:55.740145+0000","last_peered":"2024-09-17T07:49:55.740145+0000","last_clean":"2024-09-17T07:49:55.740145+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T07:49:55.740145+0000","last_undegraded":"2024-09-17T07:49:55.740145+0000","last_fullsized":"2024-09-17T07:49:55.740145+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":122880,"data_stored":34625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":729088,"data_stored":628562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":724992,"data_stored":627801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T07:49:59.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T07:50:00.066 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:50:00.069 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T07:50:00.080 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-17T07:49:58.525175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":893628,"kb_used_data":1540,"kb_used_omap":4,"kb_used_meta":892027,"kb_avail":282221892,"statfs":{"total":289910292480,"available":288995217408,"internally_reserved":0,"allocated":1576960,"data_stored":1290988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":913435656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.807610"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.747331+0000","last_change":"2024-09-17T07:49:56.747739+0000","last_active":"2024-09-17T07:49:56.747331+0000","last_peered":"2024-09-17T07:49:56.747331+0000","last_clean":"2024-09-17T07:49:56.747331+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T07:49:56.747331+0000","last_undegraded":"2024-09-17T07:49:56.747331+0000","last_fullsized":"2024-09-17T07:49:56.747331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014763790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.747176+0000","last_change":"2024-09-17T07:49:56.747442+0000","last_active":"2024-09-17T07:49:56.747176+0000","last_peered":"2024-09-17T07:49:56.747176+0000","last_clean":"2024-09-17T07:49:56.747176+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T07:49:56.747176+0000","last_undegraded":"2024-09-17T07:49:56.747176+0000","last_fullsized":"2024-09-17T07:49:56.747176+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001292358,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.746580+0000","last_change":"2024-09-17T07:49:56.747006+0000","last_active":"2024-09-17T07:49:56.746580+0000","last_peered":"2024-09-17T07:49:56.746580+0000","last_clean":"2024-09-17T07:49:56.746580+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T07:49:56.746580+0000","last_undegraded":"2024-09-17T07:49:56.746580+0000","last_fullsized":"2024-09-17T07:49:56.746580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090165199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.745994+0000","last_change":"2024-09-17T07:49:56.746303+0000","last_active":"2024-09-17T07:49:56.745994+0000","last_peered":"2024-09-17T07:49:56.745994+0000","last_clean":"2024-09-17T07:49:56.745994+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T07:49:56.745994+0000","last_undegraded":"2024-09-17T07:49:56.745994+0000","last_fullsized":"2024-09-17T07:49:56.745994+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000749937,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.740099+0000","last_change":"2024-09-17T07:49:56.740099+0000","last_active":"2024-09-17T07:49:56.740099+0000","last_peered":"2024-09-17T07:49:56.740099+0000","last_clean":"2024-09-17T07:49:56.740099+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T07:49:56.740099+0000","last_undegraded":"2024-09-17T07:49:56.740099+0000","last_fullsized":"2024-09-17T07:49:56.740099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074672400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:57.550434+0000","last_change":"2024-09-17T07:49:57.550747+0000","last_active":"2024-09-17T07:49:57.550434+0000","last_peered":"2024-09-17T07:49:57.550434+0000","last_clean":"2024-09-17T07:49:57.550434+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T07:49:57.550434+0000","last_undegraded":"2024-09-17T07:49:57.550434+0000","last_fullsized":"2024-09-17T07:49:57.550434+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:13.546583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057517600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:57.550308+0000","last_change":"2024-09-17T07:49:57.550683+0000","last_active":"2024-09-17T07:49:57.550308+0000","last_peered":"2024-09-17T07:49:57.550308+0000","last_clean":"2024-09-17T07:49:57.550308+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T07:49:57.550308+0000","last_undegraded":"2024-09-17T07:49:57.550308+0000","last_fullsized":"2024-09-17T07:49:57.550308+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:58.525227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057602900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T07:49:56.746439+0000","last_change":"2024-09-17T07:49:56.746889+0000","last_active":"2024-09-17T07:49:56.746439+0000","last_peered":"2024-09-17T07:49:56.746439+0000","last_clean":"2024-09-17T07:49:56.746439+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T07:49:56.746439+0000","last_undegraded":"2024-09-17T07:49:56.746439+0000","last_fullsized":"2024-09-17T07:49:56.746439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010646710000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'52","reported_seq":80,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-17T07:49:55.740145+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T07:49:55.740145+0000","last_peered":"2024-09-17T07:49:55.740145+0000","last_clean":"2024-09-17T07:49:55.740145+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T07:49:55.740145+0000","last_undegraded":"2024-09-17T07:49:55.740145+0000","last_fullsized":"2024-09-17T07:49:55.740145+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":122880,"data_stored":34625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":729088,"data_stored":628562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":724992,"data_stored":627801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T07:50:00.081 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T07:50:00.081 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T07:50:00.081 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T07:50:00.081 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T07:50:00.393 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T07:50:00.393 INFO:teuthology.orchestra.run.smithi184.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T07:50:00.406 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T07:50:00.407 INFO:teuthology.run_tasks:Running task exec... 2024-09-17T07:50:00.420 INFO:teuthology.task.exec:Executing custom commands... 2024-09-17T07:50:00.421 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T07:50:00.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2024-09-17T07:50:00.810 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'cache' created 2024-09-17T07:50:00.823 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2024-09-17T07:50:01.821 INFO:teuthology.orchestra.run.smithi184.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2024-09-17T07:50:01.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2024-09-17T07:50:02.825 INFO:teuthology.orchestra.run.smithi184.stderr:set cache-mode for pool 'cache' to writeback 2024-09-17T07:50:02.838 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2024-09-17T07:50:04.142 INFO:teuthology.orchestra.run.smithi184.stderr:overlay for 'rbd' is now (or already was) 'cache' 2024-09-17T07:50:04.158 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2024-09-17T07:50:05.148 INFO:teuthology.orchestra.run.smithi184.stderr:set pool 3 hit_set_type to bloom 2024-09-17T07:50:05.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2024-09-17T07:50:06.150 INFO:teuthology.orchestra.run.smithi184.stderr:set pool 3 hit_set_count to 8 2024-09-17T07:50:06.164 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2024-09-17T07:50:07.161 INFO:teuthology.orchestra.run.smithi184.stderr:set pool 3 hit_set_period to 60 2024-09-17T07:50:07.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2024-09-17T07:50:08.162 INFO:teuthology.orchestra.run.smithi184.stderr:set pool 3 target_max_objects to 250 2024-09-17T07:50:08.176 INFO:teuthology.run_tasks:Running task workunit... 2024-09-17T07:50:08.190 INFO:tasks.workunit:Pulling workunits from ref d75f23820806da622f561ee5ee7551015285993f 2024-09-17T07:50:08.190 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T07:50:08.190 DEBUG:teuthology.orchestra.run.smithi184:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T07:50:08.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T07:50:08.198 INFO:teuthology.orchestra.run.smithi184.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-17T07:50:08.199 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-17T07:50:08.206 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-17T07:50:08.206 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-17T07:50:08.212 INFO:tasks.workunit:timeout=3h 2024-09-17T07:50:08.213 INFO:tasks.workunit:cleanup=True 2024-09-17T07:50:08.213 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d75f23820806da622f561ee5ee7551015285993f 2024-09-17T07:50:08.261 INFO:tasks.workunit.client.0.smithi184.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T07:51:02.858 INFO:tasks.workunit.client.0.smithi184.stderr:Note: switching to 'd75f23820806da622f561ee5ee7551015285993f'. 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr: git switch -c 2024-09-17T07:51:02.859 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-09-17T07:51:02.860 INFO:tasks.workunit.client.0.smithi184.stderr:Or undo this operation with: 2024-09-17T07:51:02.860 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-09-17T07:51:02.860 INFO:tasks.workunit.client.0.smithi184.stderr: git switch - 2024-09-17T07:51:02.860 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-09-17T07:51:02.860 INFO:tasks.workunit.client.0.smithi184.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T07:51:02.860 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-09-17T07:51:02.860 INFO:tasks.workunit.client.0.smithi184.stderr:HEAD is now at d75f2382080 Merge branch 'wip-67762-quincy' of https://github.com/nbalacha/ceph into wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-17T07:51:02.863 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T07:51:02.887 INFO:tasks.workunit.client.0.smithi184.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T07:51:02.890 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T07:51:02.890 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T07:51:03.795 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T07:51:03.917 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T07:51:03.981 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T07:51:03.983 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T07:51:03.983 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T07:51:04.050 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T07:51:04.056 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-09-17T07:51:04.056 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T07:51:04.064 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2024-09-17T07:51:04.065 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2024-09-17T07:51:04.065 DEBUG:teuthology.orchestra.run.smithi184:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2024-09-17T07:51:04.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ TIMEOUT=300 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ MAX_TIMEOUT=15 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ PG_NUM=4 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ TMPDIR=/tmp 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ TESTDIR=/home/ubuntu/cephtest 2024-09-17T07:51:04.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ type xmlstarlet 2024-09-17T07:51:04.125 INFO:tasks.workunit.client.0.smithi184.stderr:++ XMLSTARLET=xmlstarlet 2024-09-17T07:51:04.125 INFO:tasks.workunit.client.0.smithi184.stderr:+++ uname 2024-09-17T07:51:04.125 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' Linux = FreeBSD ']' 2024-09-17T07:51:04.125 INFO:tasks.workunit.client.0.smithi184.stderr:++ SED=sed 2024-09-17T07:51:04.125 INFO:tasks.workunit.client.0.smithi184.stderr:++ AWK=awk 2024-09-17T07:51:04.126 INFO:tasks.workunit.client.0.smithi184.stderr:+++ stty -a 2024-09-17T07:51:04.126 INFO:tasks.workunit.client.0.smithi184.stderr:+++ head -1 2024-09-17T07:51:04.126 INFO:tasks.workunit.client.0.smithi184.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2024-09-17T07:51:04.138 INFO:tasks.workunit.client.0.smithi184.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-17T07:51:04.139 INFO:tasks.workunit.client.0.smithi184.stderr:++ termwidth= 2024-09-17T07:51:04.139 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2024-09-17T07:51:04.139 INFO:tasks.workunit.client.0.smithi184.stderr:++ DIFFCOLOPTS='-y ' 2024-09-17T07:51:04.139 INFO:tasks.workunit.client.0.smithi184.stderr:++ KERNCORE=kernel.core_pattern 2024-09-17T07:51:04.139 INFO:tasks.workunit.client.0.smithi184.stderr:++ EXTRA_OPTS= 2024-09-17T07:51:04.152 INFO:tasks.workunit.client.0.smithi184.stderr:++ test '' = TESTS 2024-09-17T07:51:04.152 INFO:tasks.workunit.client.0.smithi184.stderr:+ export RBD_FORCE_ALLOW_V1=1 2024-09-17T07:51:04.153 INFO:tasks.workunit.client.0.smithi184.stderr:+ RBD_FORCE_ALLOW_V1=1 2024-09-17T07:51:04.153 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:04.153 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:04.154 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v '^0$' 2024-09-17T07:51:04.198 INFO:tasks.workunit.client.0.smithi184.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2024-09-17T07:51:04.198 INFO:tasks.workunit.client.0.smithi184.stderr:+ tiered=0 2024-09-17T07:51:04.198 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd dump 2024-09-17T07:51:04.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^pool' 2024-09-17T07:51:04.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ''\''rbd'\''' 2024-09-17T07:51:04.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep tier 2024-09-17T07:51:04.592 INFO:tasks.workunit.client.0.smithi184.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 lfor 20/20/20 flags hashpspool,selfmanaged_snaps tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2024-09-17T07:51:04.593 INFO:tasks.workunit.client.0.smithi184.stderr:+ tiered=1 2024-09-17T07:51:04.609 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_pool_image_args 2024-09-17T07:51:04.609 INFO:tasks.workunit.client.0.smithi184.stdout:testing pool and image args... 2024-09-17T07:51:04.610 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing pool and image args...' 2024-09-17T07:51:04.610 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:51:04.610 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:04.722 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:04.838 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:04.957 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.073 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.192 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.421 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.656 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.766 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:05.882 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:06.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:06.118 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:06.233 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:06.347 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:06.464 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:06.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:06.693 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-17T07:51:07.091 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'test' does not exist 2024-09-17T07:51:07.099 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool create test 32 2024-09-17T07:51:08.335 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'test' already exists 2024-09-17T07:51:08.344 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd pool init test 2024-09-17T07:51:11.261 INFO:tasks.workunit.client.0.smithi184.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2024-09-17T07:51:11.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:11.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:11.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:51:11.312 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:51:11.313 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 1 test1 2024-09-17T07:51:11.353 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:11.350+0000 7f0c3ddbc4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:13.277 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:13.277 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test1 2024-09-17T07:51:13.314 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import --image test2 /tmp/empty 2024-09-17T07:51:13.354 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:13.350+0000 7f581bf7b4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:13.373 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:13.374 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: --image is deprecated, use --dest 2024-09-17T07:51:13.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:13.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test2 2024-09-17T07:51:13.423 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --dest test3 import /tmp/empty 2024-09-17T07:51:13.465 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:13.462+0000 7f69ea0f74c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:13.484 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:13.489 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:13.489 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test3 2024-09-17T07:51:13.530 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import /tmp/empty foo 2024-09-17T07:51:13.570 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:13.566+0000 7fb535bd14c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:13.588 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:13.593 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:13.593 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q foo 2024-09-17T07:51:13.638 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2024-09-17T07:51:13.666 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-17T07:51:13.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:51:13.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import /tmp/empty test/empty@snap 2024-09-17T07:51:13.694 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-17T07:51:13.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:51:13.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import --image test/empty@snap /tmp/empty 2024-09-17T07:51:13.725 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-17T07:51:13.725 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: --image is deprecated, use --dest 2024-09-17T07:51:13.726 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:51:13.726 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import /tmp/empty@snap 2024-09-17T07:51:13.750 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-17T07:51:13.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:51:13.752 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:13.752 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:13.752 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:51:13.792 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:51:13.792 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import /tmp/empty test/test1 2024-09-17T07:51:13.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:13.822+0000 7ff1c89654c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:15.295 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:15.299 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:15.299 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test1 2024-09-17T07:51:15.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd -p test import /tmp/empty test2 2024-09-17T07:51:15.582 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:15.578+0000 7f34acfb34c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:15.601 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:15.602 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-17T07:51:15.607 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:15.607 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test2 2024-09-17T07:51:15.649 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --image test3 -p test import /tmp/empty 2024-09-17T07:51:15.692 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:15.690+0000 7f17801aa4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:15.710 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:15.711 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: --image is deprecated, use --dest 2024-09-17T07:51:15.711 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-17T07:51:15.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:15.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test3 2024-09-17T07:51:15.757 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --image test4 -p test import /tmp/empty 2024-09-17T07:51:15.799 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:15.794+0000 7fedbcbf64c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:15.816 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:15.817 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: --image is deprecated, use --dest 2024-09-17T07:51:15.817 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-17T07:51:15.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:15.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test4 2024-09-17T07:51:15.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --dest test5 -p test import /tmp/empty 2024-09-17T07:51:15.911 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:15.906+0000 7f7fc3dea4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:15.932 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:15.933 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-17T07:51:15.937 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:15.937 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test5 2024-09-17T07:51:15.979 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2024-09-17T07:51:16.023 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:16.018+0000 7fd6e7f9c4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:16.046 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:16.052 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:16.053 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test6 2024-09-17T07:51:16.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2024-09-17T07:51:16.137 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:16.134+0000 7fc8a125e4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:16.159 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:16.160 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: --image is deprecated, use --dest 2024-09-17T07:51:16.165 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:16.166 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test7 2024-09-17T07:51:16.210 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --image test/test8 import /tmp/empty 2024-09-17T07:51:16.251 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:16.246+0000 7fa8652594c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:16.274 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:16.274 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: --image is deprecated, use --dest 2024-09-17T07:51:16.279 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:16.279 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test8 2024-09-17T07:51:16.325 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --dest test/test9 import /tmp/empty 2024-09-17T07:51:16.365 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:16.362+0000 7eff2694e4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:16.388 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:16.394 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:16.394 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test9 2024-09-17T07:51:16.437 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import --pool test /tmp/empty 2024-09-17T07:51:16.477 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:16.474+0000 7f66e58074c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:16.495 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:51:16.496 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-17T07:51:16.501 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:16.501 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q empty 2024-09-17T07:51:16.544 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy test/test9 test10 2024-09-17T07:51:16.636 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:51:16.643 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:16.643 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -qv test10 2024-09-17T07:51:16.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:16.890 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test10 2024-09-17T07:51:16.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy test/test9 test/test10 2024-09-17T07:51:17.016 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:51:17.021 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:17.021 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test10 2024-09-17T07:51:17.066 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2024-09-17T07:51:17.358 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:51:17.364 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:17.365 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -q test11 2024-09-17T07:51:17.406 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2024-09-17T07:51:17.493 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:51:17.500 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:17.500 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test12 2024-09-17T07:51:17.540 INFO:tasks.workunit.client.0.smithi184.stdout:test12 2024-09-17T07:51:17.541 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls test 2024-09-17T07:51:17.541 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -qv test12 2024-09-17T07:51:17.585 INFO:tasks.workunit.client.0.smithi184.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2024-09-17T07:51:17.587 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-17T07:51:18.264 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'test' does not exist 2024-09-17T07:51:18.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-17T07:51:18.273 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm foo 2024-09-17T07:51:18.329 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:18.332 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-17T07:51:18.332 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:51:18.384 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:18.388 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-17T07:51:18.389 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test10 2024-09-17T07:51:18.511 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:18.516 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-17T07:51:18.516 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test12 2024-09-17T07:51:18.639 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:18.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-17T07:51:18.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:51:18.704 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:18.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-17T07:51:18.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test3 2024-09-17T07:51:18.771 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:18.775 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_rename 2024-09-17T07:51:18.776 INFO:tasks.workunit.client.0.smithi184.stdout:testing rename... 2024-09-17T07:51:18.776 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing rename...' 2024-09-17T07:51:18.776 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:51:18.776 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:18.892 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.011 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.130 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.249 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.371 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.485 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.595 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.710 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:19.940 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:20.049 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:20.164 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:20.285 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:20.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:20.517 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:20.847 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:20.961 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:21.077 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 1 -s 1 foo 2024-09-17T07:51:21.108 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:51:21.123 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:21.118+0000 7f33a762b4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:21.132 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 bar 2024-09-17T07:51:21.200 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename foo foo2 2024-09-17T07:51:21.268 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename foo2 bar 2024-09-17T07:51:21.268 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep exists 2024-09-17T07:51:21.322 INFO:tasks.workunit.client.0.smithi184.stdout:2024-09-17T07:51:21.310+0000 7f12062794c0 -1 librbd::Operations: rbd image bar already exists 2024-09-17T07:51:21.322 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: rename error: (17) File exists 2024-09-17T07:51:21.322 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename bar bar2 2024-09-17T07:51:21.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename bar2 foo2 2024-09-17T07:51:21.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep exists 2024-09-17T07:51:21.458 INFO:tasks.workunit.client.0.smithi184.stdout:2024-09-17T07:51:21.446+0000 7ff995cb34c0 -1 librbd::Operations: rbd image foo2 already exists 2024-09-17T07:51:21.458 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: rename error: (17) File exists 2024-09-17T07:51:21.458 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool create rbd2 8 2024-09-17T07:51:22.721 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'rbd2' already exists 2024-09-17T07:51:22.729 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd pool init rbd2 2024-09-17T07:51:25.659 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -p rbd2 -s 1 foo 2024-09-17T07:51:25.700 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:25.697+0000 7fd3178434c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:27.664 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename rbd2/foo rbd2/bar 2024-09-17T07:51:27.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd -p rbd2 ls 2024-09-17T07:51:27.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep bar 2024-09-17T07:51:27.965 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:27.965+0000 7f15abe21700 0 --2- 172.21.15.184:0/4080576618 >> v2:172.21.15.184:3300/0 conn(0x55b20e1db250 0x55b20e1dac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T07:51:27.986 INFO:tasks.workunit.client.0.smithi184.stdout:bar 2024-09-17T07:51:27.986 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename rbd2/bar foo 2024-09-17T07:51:28.055 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename --pool rbd2 foo bar 2024-09-17T07:51:28.128 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2024-09-17T07:51:28.157 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: mv/rename across pools not supported 2024-09-17T07:51:28.157 INFO:tasks.workunit.client.0.smithi184.stderr:source pool: rbd2 dest pool: rbd 2024-09-17T07:51:28.159 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2024-09-17T07:51:28.230 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd -p rbd2 ls 2024-09-17T07:51:28.230 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep foo 2024-09-17T07:51:28.273 INFO:tasks.workunit.client.0.smithi184.stdout:foo 2024-09-17T07:51:28.273 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2024-09-17T07:51:28.770 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'rbd2' does not exist 2024-09-17T07:51:28.778 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:51:28.778 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:28.893 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.120 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.466 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.699 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.813 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:29.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:30.047 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:30.165 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:30.399 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:30.513 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:30.623 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:30.948 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:31.065 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:31.180 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_ls 2024-09-17T07:51:31.180 INFO:tasks.workunit.client.0.smithi184.stdout:testing ls... 2024-09-17T07:51:31.181 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing ls...' 2024-09-17T07:51:31.181 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:51:31.181 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:31.297 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:31.407 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:31.728 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:31.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:31.961 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:32.073 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:32.190 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:32.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:32.427 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:32.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:32.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:32.985 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:33.105 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:33.226 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:33.335 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:33.446 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:33.563 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:33.675 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 1 -s 1 test1 2024-09-17T07:51:33.703 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:51:33.717 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:33.717+0000 7f6b9456d4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:33.731 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 1 -s 1 test2 2024-09-17T07:51:33.760 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:51:33.771 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:33.769+0000 7f5bd8ed94c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:33.783 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:33.783 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:51:33.825 INFO:tasks.workunit.client.0.smithi184.stdout:test1 2024-09-17T07:51:33.825 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:33.826 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test2 2024-09-17T07:51:33.866 INFO:tasks.workunit.client.0.smithi184.stdout:test2 2024-09-17T07:51:33.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:33.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:33.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:51:33.909 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:51:33.909 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:33.909 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test1.*1 MiB.*1' 2024-09-17T07:51:33.962 INFO:tasks.workunit.client.0.smithi184.stdout:test1 1 MiB 1 2024-09-17T07:51:33.963 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:33.963 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test2.*1 MiB.*1' 2024-09-17T07:51:34.017 INFO:tasks.workunit.client.0.smithi184.stdout:test2 1 MiB 1 2024-09-17T07:51:34.018 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:51:34.084 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:34.089 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:51:34.159 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:34.163 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-17T07:51:34.242 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-17T07:51:34.309 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:34.309 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:51:34.351 INFO:tasks.workunit.client.0.smithi184.stdout:test1 2024-09-17T07:51:34.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:34.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test2 2024-09-17T07:51:34.393 INFO:tasks.workunit.client.0.smithi184.stdout:test2 2024-09-17T07:51:34.394 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:34.394 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:51:34.394 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:34.435 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:51:34.435 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:34.435 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test1.*1 MiB.*2' 2024-09-17T07:51:34.494 INFO:tasks.workunit.client.0.smithi184.stdout:test1 1 MiB 2 2024-09-17T07:51:34.495 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:34.495 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test2.*1 MiB.*2' 2024-09-17T07:51:34.558 INFO:tasks.workunit.client.0.smithi184.stdout:test2 1 MiB 2 2024-09-17T07:51:34.558 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:51:34.723 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:34.721+0000 7f629ffd7700 0 -- 172.21.15.184:0/1228457412 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f6284008980 msgr2=0x7f628400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:34.723 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:34.728 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:51:34.885 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:34.885+0000 7f8cf7ba4700 0 -- 172.21.15.184:0/2059350244 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f8cdc008980 msgr2=0x7f8cdc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:34.885 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:34.890 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-17T07:51:34.958 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 1 -s 1 test2 2024-09-17T07:51:34.986 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:51:34.996 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:34.993+0000 7f2506eb74c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:35.006 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:35.006 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:51:35.048 INFO:tasks.workunit.client.0.smithi184.stdout:test1 2024-09-17T07:51:35.049 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:35.049 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test2 2024-09-17T07:51:35.089 INFO:tasks.workunit.client.0.smithi184.stdout:test2 2024-09-17T07:51:35.090 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:35.090 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:35.090 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:51:35.129 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:51:35.130 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:35.130 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test1.*1 MiB.*2' 2024-09-17T07:51:35.186 INFO:tasks.workunit.client.0.smithi184.stdout:test1 1 MiB 2 2024-09-17T07:51:35.186 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:35.186 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test2.*1 MiB.*1' 2024-09-17T07:51:35.247 INFO:tasks.workunit.client.0.smithi184.stdout:test2 1 MiB 1 2024-09-17T07:51:35.248 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:51:35.248 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:35.361 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:35.479 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:35.597 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:35.708 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:35.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:35.943 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:36.064 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:36.181 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:36.295 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:36.411 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:36.528 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:36.644 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:36.767 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:37.026 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:37.151 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:37.270 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:37.593 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:51:37.709 INFO:tasks.workunit.client.0.smithi184.stderr:++ seq -w 00 99 2024-09-17T07:51:37.723 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:37.724 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.00 -s 1 2024-09-17T07:51:37.768 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:37.765+0000 7fdbb4ad94c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:37.778 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:37.778 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.01 -s 1 2024-09-17T07:51:37.819 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:37.817+0000 7fef5a9c74c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:37.829 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:37.829 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.02 -s 1 2024-09-17T07:51:37.867 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:37.865+0000 7f19509ca4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:37.878 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:37.878 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.03 -s 1 2024-09-17T07:51:37.920 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:37.917+0000 7f5db24074c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:37.937 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:37.937 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.04 -s 1 2024-09-17T07:51:38.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.177+0000 7fd3562bb4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.193 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.193 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.05 -s 1 2024-09-17T07:51:38.232 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.229+0000 7fed158d64c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.241 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.241 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.06 -s 1 2024-09-17T07:51:38.282 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.281+0000 7f24d8bd54c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.291 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.291 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.07 -s 1 2024-09-17T07:51:38.329 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.325+0000 7fd3c21d34c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.338 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.338 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.08 -s 1 2024-09-17T07:51:38.381 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.381+0000 7f8b454c14c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.390 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.390 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.09 -s 1 2024-09-17T07:51:38.431 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.429+0000 7f92d40b94c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.441 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.441 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.10 -s 1 2024-09-17T07:51:38.479 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.477+0000 7f710bf894c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.490 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.490 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.11 -s 1 2024-09-17T07:51:38.531 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.529+0000 7fe9125ad4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.543 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.544 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.12 -s 1 2024-09-17T07:51:38.582 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.581+0000 7f255416f4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.13 -s 1 2024-09-17T07:51:38.631 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.629+0000 7f5b479bd4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.641 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.641 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.14 -s 1 2024-09-17T07:51:38.682 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.681+0000 7fed251684c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.696 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.696 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.15 -s 1 2024-09-17T07:51:38.739 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.737+0000 7fbeee0924c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.16 -s 1 2024-09-17T07:51:38.790 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.789+0000 7f29f5c424c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.801 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.801 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.17 -s 1 2024-09-17T07:51:38.840 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.837+0000 7f9865a2e4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.850 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.850 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.18 -s 1 2024-09-17T07:51:38.889 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.885+0000 7fd8b490d4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.19 -s 1 2024-09-17T07:51:38.941 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.941+0000 7fb0dce204c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.951 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.951 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.20 -s 1 2024-09-17T07:51:38.989 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:38.989+0000 7fcdc50964c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:38.998 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:38.998 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.21 -s 1 2024-09-17T07:51:39.039 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.037+0000 7f82de72f4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.048 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.048 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.22 -s 1 2024-09-17T07:51:39.086 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.085+0000 7f45ce0ee4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.096 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.23 -s 1 2024-09-17T07:51:39.135 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.133+0000 7fbe22f0c4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.145 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.145 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.24 -s 1 2024-09-17T07:51:39.187 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.185+0000 7f8d833084c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.25 -s 1 2024-09-17T07:51:39.241 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.241+0000 7f7d26e324c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.26 -s 1 2024-09-17T07:51:39.294 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.293+0000 7f0eaa0544c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.305 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.305 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.27 -s 1 2024-09-17T07:51:39.341 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.341+0000 7f110ae164c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.28 -s 1 2024-09-17T07:51:39.389 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.385+0000 7f573dc604c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.401 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.401 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.29 -s 1 2024-09-17T07:51:39.442 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.441+0000 7f7ebc9f04c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.454 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.454 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.30 -s 1 2024-09-17T07:51:39.494 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.493+0000 7f0f47bbe4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.505 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.505 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.31 -s 1 2024-09-17T07:51:39.545 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.541+0000 7ff94b7e74c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.560 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.561 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.32 -s 1 2024-09-17T07:51:39.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.601+0000 7f556bcd54c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.615 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.615 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.33 -s 1 2024-09-17T07:51:39.659 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.657+0000 7f6f5cafb4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.672 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.673 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.34 -s 1 2024-09-17T07:51:39.713 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.713+0000 7fb56b7284c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.728 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.728 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.35 -s 1 2024-09-17T07:51:39.771 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.769+0000 7fa067df84c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.785 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.785 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.36 -s 1 2024-09-17T07:51:39.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.825+0000 7fee436dc4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.37 -s 1 2024-09-17T07:51:39.886 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.884+0000 7f961baf64c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.897 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.898 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.38 -s 1 2024-09-17T07:51:39.939 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.936+0000 7f33405594c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.949 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.949 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.39 -s 1 2024-09-17T07:51:39.988 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:39.984+0000 7eff97b664c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:39.996 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:39.997 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.40 -s 1 2024-09-17T07:51:40.036 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.032+0000 7f78127fd4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.050 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.050 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.41 -s 1 2024-09-17T07:51:40.093 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.092+0000 7f20e1dfc4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.110 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.110 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.42 -s 1 2024-09-17T07:51:40.149 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.148+0000 7f99f6d9c4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.161 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.161 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.43 -s 1 2024-09-17T07:51:40.201 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.200+0000 7f9a20f944c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.217 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.217 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.44 -s 1 2024-09-17T07:51:40.259 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.256+0000 7f02017b64c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.275 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.275 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.45 -s 1 2024-09-17T07:51:40.317 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.312+0000 7efeb8d704c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.329 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.330 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.46 -s 1 2024-09-17T07:51:40.371 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.368+0000 7f5e0dc9e4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.385 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.386 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.47 -s 1 2024-09-17T07:51:40.426 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.424+0000 7f427e1b84c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.440 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.440 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.48 -s 1 2024-09-17T07:51:40.481 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.476+0000 7f69279264c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.492 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.493 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.49 -s 1 2024-09-17T07:51:40.532 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.528+0000 7f7216fdd4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.542 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.542 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.50 -s 1 2024-09-17T07:51:40.583 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.580+0000 7f7850fb34c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.594 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.594 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.51 -s 1 2024-09-17T07:51:40.633 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.632+0000 7fe1d90624c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.643 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.643 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.52 -s 1 2024-09-17T07:51:40.681 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.676+0000 7f0a54bb94c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.692 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.692 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.53 -s 1 2024-09-17T07:51:40.733 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.728+0000 7ff8cb4e84c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.54 -s 1 2024-09-17T07:51:40.781 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.780+0000 7f719aa234c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.793 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.793 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.55 -s 1 2024-09-17T07:51:40.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.828+0000 7ff27207e4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.56 -s 1 2024-09-17T07:51:40.891 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.888+0000 7f4624a844c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.907 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.907 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.57 -s 1 2024-09-17T07:51:40.951 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:40.948+0000 7fabbb9a14c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:40.967 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:40.968 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.58 -s 1 2024-09-17T07:51:41.003 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.000+0000 7f88786da4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.013 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.014 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.59 -s 1 2024-09-17T07:51:41.053 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.048+0000 7fbd5f2f24c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.062 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.60 -s 1 2024-09-17T07:51:41.103 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.100+0000 7f92858124c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.115 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.115 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.61 -s 1 2024-09-17T07:51:41.155 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.152+0000 7f77552fb4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.166 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.166 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.62 -s 1 2024-09-17T07:51:41.206 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.204+0000 7f1f0b6ad4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.217 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.217 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.63 -s 1 2024-09-17T07:51:41.254 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.252+0000 7f554cf664c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.264 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.264 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.64 -s 1 2024-09-17T07:51:41.303 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.300+0000 7f3adb22d4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.313 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.313 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.65 -s 1 2024-09-17T07:51:41.350 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.348+0000 7fbfaee014c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.366 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.366 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.66 -s 1 2024-09-17T07:51:41.408 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.404+0000 7fc0994634c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.425 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.425 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.67 -s 1 2024-09-17T07:51:41.468 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.464+0000 7febb6c084c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.478 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.478 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.68 -s 1 2024-09-17T07:51:41.520 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.516+0000 7ff5fde484c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.534 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.534 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.69 -s 1 2024-09-17T07:51:41.575 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.572+0000 7f9ef41fa4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.585 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.585 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.70 -s 1 2024-09-17T07:51:41.620 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.616+0000 7f4ab2ead4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.631 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.631 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.71 -s 1 2024-09-17T07:51:41.670 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.668+0000 7f32aa3a34c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.682 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.682 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.72 -s 1 2024-09-17T07:51:41.718 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.716+0000 7f8f61c0f4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.728 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.728 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.73 -s 1 2024-09-17T07:51:41.766 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.764+0000 7f4aacc064c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.779 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.779 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.74 -s 1 2024-09-17T07:51:41.813 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.808+0000 7f814d28c4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.75 -s 1 2024-09-17T07:51:41.863 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.860+0000 7f66e035d4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.878 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.878 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.76 -s 1 2024-09-17T07:51:41.922 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.920+0000 7f806081f4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.77 -s 1 2024-09-17T07:51:41.972 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:41.968+0000 7f3bac7214c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:41.983 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:41.983 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.78 -s 1 2024-09-17T07:51:42.023 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.020+0000 7f6990d204c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.033 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.033 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.79 -s 1 2024-09-17T07:51:42.072 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.068+0000 7f3d04b854c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.082 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.083 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.80 -s 1 2024-09-17T07:51:42.122 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.120+0000 7f53872a04c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.81 -s 1 2024-09-17T07:51:42.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.176+0000 7f7558ffa4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.197 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.197 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.82 -s 1 2024-09-17T07:51:42.239 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.236+0000 7f5712f804c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.254 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.254 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.83 -s 1 2024-09-17T07:51:42.294 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.292+0000 7ff4fca314c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.309 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.309 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.84 -s 1 2024-09-17T07:51:42.346 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.344+0000 7f4ee27c34c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.363 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.363 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.85 -s 1 2024-09-17T07:51:42.406 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.404+0000 7f52fe6024c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.420 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.420 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.86 -s 1 2024-09-17T07:51:42.461 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.456+0000 7f8328ffa4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.476 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.476 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.87 -s 1 2024-09-17T07:51:42.519 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.516+0000 7f69956bd4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.530 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.531 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.88 -s 1 2024-09-17T07:51:42.570 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.568+0000 7fdc609f84c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.586 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.586 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.89 -s 1 2024-09-17T07:51:42.624 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.620+0000 7f55eee604c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.636 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.90 -s 1 2024-09-17T07:51:42.675 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.672+0000 7f0a24e294c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.688 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.688 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.91 -s 1 2024-09-17T07:51:42.729 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.724+0000 7f8a4f6614c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.92 -s 1 2024-09-17T07:51:42.785 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.784+0000 7f73a29424c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.799 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.799 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.93 -s 1 2024-09-17T07:51:42.839 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.836+0000 7f79d4bb64c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.850 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.851 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.94 -s 1 2024-09-17T07:51:42.889 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.884+0000 7fd5c35e54c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.901 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.901 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.95 -s 1 2024-09-17T07:51:42.937 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.936+0000 7f1738f594c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:42.953 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:42.953 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.96 -s 1 2024-09-17T07:51:42.991 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:42.988+0000 7f46454094c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:43.003 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.003 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.97 -s 1 2024-09-17T07:51:43.045 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:43.040+0000 7f1f45cf24c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:43.062 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.98 -s 1 2024-09-17T07:51:43.109 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:43.104+0000 7ff3dd9bc4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:43.125 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.126 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.99 -s 1 2024-09-17T07:51:43.168 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:43.164+0000 7f7093c334c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:51:43.183 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:43.183 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:43.183 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 100 2024-09-17T07:51:43.223 INFO:tasks.workunit.client.0.smithi184.stdout:100 2024-09-17T07:51:43.224 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:43.224 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep image 2024-09-17T07:51:43.224 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:43.225 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 100 2024-09-17T07:51:43.325 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:43.320+0000 7f98c9616700 0 -- 172.21.15.184:0/2929751943 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55c38f5079c0 msgr2=0x55c38f50d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:43.337 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:43.336+0000 7f98c9616700 0 -- 172.21.15.184:0/2929751943 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f98ac03a6f0 msgr2=0x7f98ac03cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:43.539 INFO:tasks.workunit.client.0.smithi184.stdout:100 2024-09-17T07:51:43.539 INFO:tasks.workunit.client.0.smithi184.stderr:++ seq -w 00 99 2024-09-17T07:51:43.540 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.540 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.00 2024-09-17T07:51:43.600 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:43.605 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.605 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.01 2024-09-17T07:51:43.670 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:43.677 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.677 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.02 2024-09-17T07:51:43.744 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:43.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.03 2024-09-17T07:51:43.812 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:43.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.04 2024-09-17T07:51:43.898 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:43.903 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.903 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.05 2024-09-17T07:51:43.967 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:43.972 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:43.972 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.06 2024-09-17T07:51:44.033 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.038 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.038 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.07 2024-09-17T07:51:44.102 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.107 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.107 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.08 2024-09-17T07:51:44.172 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.09 2024-09-17T07:51:44.235 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.10 2024-09-17T07:51:44.306 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.311 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.311 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.11 2024-09-17T07:51:44.378 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.382 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.382 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.12 2024-09-17T07:51:44.449 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.455 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.455 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.13 2024-09-17T07:51:44.521 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.526 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.526 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.14 2024-09-17T07:51:44.596 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.601 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.601 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.15 2024-09-17T07:51:44.666 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.16 2024-09-17T07:51:44.738 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.17 2024-09-17T07:51:44.811 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.18 2024-09-17T07:51:44.881 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.885 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.885 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.19 2024-09-17T07:51:44.950 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:44.955 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:44.955 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.20 2024-09-17T07:51:45.015 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.019 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.019 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.21 2024-09-17T07:51:45.086 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.091 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.091 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.22 2024-09-17T07:51:45.160 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.164 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.165 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.23 2024-09-17T07:51:45.234 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.24 2024-09-17T07:51:45.306 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.312 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.312 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.25 2024-09-17T07:51:45.377 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.381 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.381 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.26 2024-09-17T07:51:45.450 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.27 2024-09-17T07:51:45.519 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.524 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.524 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.28 2024-09-17T07:51:45.586 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.590 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.590 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.29 2024-09-17T07:51:45.650 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.655 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.655 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.30 2024-09-17T07:51:45.718 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.722 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.722 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.31 2024-09-17T07:51:45.784 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.788 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.788 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.32 2024-09-17T07:51:45.854 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.858 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.858 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.33 2024-09-17T07:51:45.921 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.34 2024-09-17T07:51:45.988 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:45.993 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:45.993 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.35 2024-09-17T07:51:46.062 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.068 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.068 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.36 2024-09-17T07:51:46.145 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.149 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.149 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.37 2024-09-17T07:51:46.211 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.215 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.215 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.38 2024-09-17T07:51:46.276 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.281 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.281 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.39 2024-09-17T07:51:46.341 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.345 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.345 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.40 2024-09-17T07:51:46.400 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.404 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.404 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.41 2024-09-17T07:51:46.465 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.469 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.470 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.42 2024-09-17T07:51:46.536 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.541 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.541 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.43 2024-09-17T07:51:46.601 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.605 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.605 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.44 2024-09-17T07:51:46.668 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.673 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.673 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.45 2024-09-17T07:51:46.753 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.758 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.758 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.46 2024-09-17T07:51:46.822 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.47 2024-09-17T07:51:46.895 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.48 2024-09-17T07:51:46.970 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:46.975 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:46.975 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.49 2024-09-17T07:51:47.064 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.069 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.069 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.50 2024-09-17T07:51:47.132 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.137 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.137 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.51 2024-09-17T07:51:47.209 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.214 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.214 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.52 2024-09-17T07:51:47.277 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.282 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.282 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.53 2024-09-17T07:51:47.344 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.350 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.350 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.54 2024-09-17T07:51:47.420 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.423 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.423 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.55 2024-09-17T07:51:47.479 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.483 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.484 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.56 2024-09-17T07:51:47.553 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.558 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.558 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.57 2024-09-17T07:51:47.622 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.58 2024-09-17T07:51:47.697 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.702 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.59 2024-09-17T07:51:47.772 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.777 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.777 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.60 2024-09-17T07:51:47.838 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.61 2024-09-17T07:51:47.914 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.919 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.919 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.62 2024-09-17T07:51:47.981 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:47.985 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:47.986 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.63 2024-09-17T07:51:48.050 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.055 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.055 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.64 2024-09-17T07:51:48.114 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.118 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.118 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.65 2024-09-17T07:51:48.179 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.184 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.184 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.66 2024-09-17T07:51:48.247 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.67 2024-09-17T07:51:48.316 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.320 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.320 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.68 2024-09-17T07:51:48.379 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.383 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.383 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.69 2024-09-17T07:51:48.450 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.454 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.454 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.70 2024-09-17T07:51:48.524 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.528 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.528 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.71 2024-09-17T07:51:48.598 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.604 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.604 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.72 2024-09-17T07:51:48.671 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.675 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.676 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.73 2024-09-17T07:51:48.738 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.74 2024-09-17T07:51:48.811 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.816 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.816 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.75 2024-09-17T07:51:48.881 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.886 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.887 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.76 2024-09-17T07:51:48.957 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:48.962 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:48.962 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.77 2024-09-17T07:51:49.025 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.029 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.029 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.78 2024-09-17T07:51:49.092 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.097 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.097 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.79 2024-09-17T07:51:49.162 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.167 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.168 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.80 2024-09-17T07:51:49.227 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.231 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.231 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.81 2024-09-17T07:51:49.293 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.298 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.298 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.82 2024-09-17T07:51:49.358 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.362 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.362 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.83 2024-09-17T07:51:49.426 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.430 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.430 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.84 2024-09-17T07:51:49.492 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.496 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.496 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.85 2024-09-17T07:51:49.553 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.557 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.558 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.86 2024-09-17T07:51:49.620 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.625 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.625 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.87 2024-09-17T07:51:49.687 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.691 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.691 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.88 2024-09-17T07:51:49.752 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.756 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.757 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.89 2024-09-17T07:51:49.836 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.842 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.842 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.90 2024-09-17T07:51:49.916 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.921 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.921 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.91 2024-09-17T07:51:49.985 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:49.990 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:49.990 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.92 2024-09-17T07:51:50.048 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.052 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.052 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.93 2024-09-17T07:51:50.113 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.117 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.117 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.94 2024-09-17T07:51:50.171 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.174 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.174 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.95 2024-09-17T07:51:50.226 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.231 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.231 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.96 2024-09-17T07:51:50.282 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.286 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.286 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.97 2024-09-17T07:51:50.349 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.352 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.352 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.98 2024-09-17T07:51:50.402 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.406 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.406 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.99 2024-09-17T07:51:50.465 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:50.468 INFO:tasks.workunit.client.0.smithi184.stderr:++ seq -w 00 99 2024-09-17T07:51:50.469 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.469 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.00 --image-format 2 -s 1 2024-09-17T07:51:50.739 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.739 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.01 --image-format 2 -s 1 2024-09-17T07:51:50.806 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.806 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.02 --image-format 2 -s 1 2024-09-17T07:51:50.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.03 --image-format 2 -s 1 2024-09-17T07:51:50.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.04 --image-format 2 -s 1 2024-09-17T07:51:50.996 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:50.996 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.05 --image-format 2 -s 1 2024-09-17T07:51:51.057 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.057 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.06 --image-format 2 -s 1 2024-09-17T07:51:51.117 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.117 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.07 --image-format 2 -s 1 2024-09-17T07:51:51.182 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.183 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.08 --image-format 2 -s 1 2024-09-17T07:51:51.249 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.250 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.09 --image-format 2 -s 1 2024-09-17T07:51:51.307 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.307 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.10 --image-format 2 -s 1 2024-09-17T07:51:51.372 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.372 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.11 --image-format 2 -s 1 2024-09-17T07:51:51.431 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.431 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.12 --image-format 2 -s 1 2024-09-17T07:51:51.488 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.488 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.13 --image-format 2 -s 1 2024-09-17T07:51:51.553 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.553 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.14 --image-format 2 -s 1 2024-09-17T07:51:51.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.15 --image-format 2 -s 1 2024-09-17T07:51:51.676 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.677 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.16 --image-format 2 -s 1 2024-09-17T07:51:51.741 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.742 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.17 --image-format 2 -s 1 2024-09-17T07:51:51.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.18 --image-format 2 -s 1 2024-09-17T07:51:51.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.19 --image-format 2 -s 1 2024-09-17T07:51:51.932 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.932 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.20 --image-format 2 -s 1 2024-09-17T07:51:51.992 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:51.992 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.21 --image-format 2 -s 1 2024-09-17T07:51:52.054 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.054 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.22 --image-format 2 -s 1 2024-09-17T07:51:52.116 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.116 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.23 --image-format 2 -s 1 2024-09-17T07:51:52.177 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.177 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.24 --image-format 2 -s 1 2024-09-17T07:51:52.242 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.242 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.25 --image-format 2 -s 1 2024-09-17T07:51:52.311 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.311 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.26 --image-format 2 -s 1 2024-09-17T07:51:52.386 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.386 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.27 --image-format 2 -s 1 2024-09-17T07:51:52.452 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.452 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.28 --image-format 2 -s 1 2024-09-17T07:51:52.516 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.516 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.29 --image-format 2 -s 1 2024-09-17T07:51:52.580 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.580 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.30 --image-format 2 -s 1 2024-09-17T07:51:52.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.31 --image-format 2 -s 1 2024-09-17T07:51:52.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.32 --image-format 2 -s 1 2024-09-17T07:51:52.773 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.773 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.33 --image-format 2 -s 1 2024-09-17T07:51:52.839 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.839 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.34 --image-format 2 -s 1 2024-09-17T07:51:52.903 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.903 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.35 --image-format 2 -s 1 2024-09-17T07:51:52.973 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:52.973 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.36 --image-format 2 -s 1 2024-09-17T07:51:53.038 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.038 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.37 --image-format 2 -s 1 2024-09-17T07:51:53.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.38 --image-format 2 -s 1 2024-09-17T07:51:53.166 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.166 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.39 --image-format 2 -s 1 2024-09-17T07:51:53.229 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.230 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.40 --image-format 2 -s 1 2024-09-17T07:51:53.289 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.289 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.41 --image-format 2 -s 1 2024-09-17T07:51:53.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.42 --image-format 2 -s 1 2024-09-17T07:51:53.424 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.424 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.43 --image-format 2 -s 1 2024-09-17T07:51:53.494 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.494 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.44 --image-format 2 -s 1 2024-09-17T07:51:53.558 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.559 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.45 --image-format 2 -s 1 2024-09-17T07:51:53.626 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.626 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.46 --image-format 2 -s 1 2024-09-17T07:51:53.690 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.690 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.47 --image-format 2 -s 1 2024-09-17T07:51:53.759 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.760 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.48 --image-format 2 -s 1 2024-09-17T07:51:53.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.49 --image-format 2 -s 1 2024-09-17T07:51:53.892 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.893 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.50 --image-format 2 -s 1 2024-09-17T07:51:53.961 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:53.961 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.51 --image-format 2 -s 1 2024-09-17T07:51:54.023 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.023 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.52 --image-format 2 -s 1 2024-09-17T07:51:54.089 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.089 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.53 --image-format 2 -s 1 2024-09-17T07:51:54.153 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.153 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.54 --image-format 2 -s 1 2024-09-17T07:51:54.217 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.217 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.55 --image-format 2 -s 1 2024-09-17T07:51:54.278 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.278 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.56 --image-format 2 -s 1 2024-09-17T07:51:54.355 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.356 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.57 --image-format 2 -s 1 2024-09-17T07:51:54.424 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.425 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.58 --image-format 2 -s 1 2024-09-17T07:51:54.489 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.489 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.59 --image-format 2 -s 1 2024-09-17T07:51:54.553 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.553 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.60 --image-format 2 -s 1 2024-09-17T07:51:54.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.61 --image-format 2 -s 1 2024-09-17T07:51:54.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.672 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.62 --image-format 2 -s 1 2024-09-17T07:51:54.735 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.735 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.63 --image-format 2 -s 1 2024-09-17T07:51:54.800 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.800 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.64 --image-format 2 -s 1 2024-09-17T07:51:54.860 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.860 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.65 --image-format 2 -s 1 2024-09-17T07:51:54.922 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:54.922 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.66 --image-format 2 -s 1 2024-09-17T07:51:55.192 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.192 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.67 --image-format 2 -s 1 2024-09-17T07:51:55.256 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.256 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.68 --image-format 2 -s 1 2024-09-17T07:51:55.319 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.319 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.69 --image-format 2 -s 1 2024-09-17T07:51:55.385 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.385 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.70 --image-format 2 -s 1 2024-09-17T07:51:55.451 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.452 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.71 --image-format 2 -s 1 2024-09-17T07:51:55.514 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.514 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.72 --image-format 2 -s 1 2024-09-17T07:51:55.582 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.582 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.73 --image-format 2 -s 1 2024-09-17T07:51:55.640 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.640 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.74 --image-format 2 -s 1 2024-09-17T07:51:55.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.75 --image-format 2 -s 1 2024-09-17T07:51:55.763 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.763 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.76 --image-format 2 -s 1 2024-09-17T07:51:55.833 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.833 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.77 --image-format 2 -s 1 2024-09-17T07:51:55.938 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:55.938 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.78 --image-format 2 -s 1 2024-09-17T07:51:56.003 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.003 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.79 --image-format 2 -s 1 2024-09-17T07:51:56.071 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.072 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.80 --image-format 2 -s 1 2024-09-17T07:51:56.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.81 --image-format 2 -s 1 2024-09-17T07:51:56.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.82 --image-format 2 -s 1 2024-09-17T07:51:56.259 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.83 --image-format 2 -s 1 2024-09-17T07:51:56.324 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.324 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.84 --image-format 2 -s 1 2024-09-17T07:51:56.394 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.395 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.85 --image-format 2 -s 1 2024-09-17T07:51:56.467 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.467 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.86 --image-format 2 -s 1 2024-09-17T07:51:56.533 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.533 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.87 --image-format 2 -s 1 2024-09-17T07:51:56.601 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.602 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.88 --image-format 2 -s 1 2024-09-17T07:51:56.663 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.663 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.89 --image-format 2 -s 1 2024-09-17T07:51:56.734 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.734 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.90 --image-format 2 -s 1 2024-09-17T07:51:56.803 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.803 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.91 --image-format 2 -s 1 2024-09-17T07:51:56.863 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.863 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.92 --image-format 2 -s 1 2024-09-17T07:51:56.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.93 --image-format 2 -s 1 2024-09-17T07:51:56.987 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:56.987 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.94 --image-format 2 -s 1 2024-09-17T07:51:57.049 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:57.050 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.95 --image-format 2 -s 1 2024-09-17T07:51:57.112 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:57.113 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.96 --image-format 2 -s 1 2024-09-17T07:51:57.179 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:57.179 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.97 --image-format 2 -s 1 2024-09-17T07:51:57.244 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:57.244 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.98 --image-format 2 -s 1 2024-09-17T07:51:57.317 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:57.317 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create image.99 --image-format 2 -s 1 2024-09-17T07:51:57.379 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:51:57.380 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:57.380 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 100 2024-09-17T07:51:57.420 INFO:tasks.workunit.client.0.smithi184.stdout:100 2024-09-17T07:51:57.421 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:51:57.421 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep image 2024-09-17T07:51:57.422 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:51:57.422 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 100 2024-09-17T07:51:57.497 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:57.492+0000 7f2bbe1a5700 0 -- 172.21.15.184:0/2197964705 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55c2b8f5f7a0 msgr2=0x55c2b8f61b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:57.505 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:57.500+0000 7f2bbe1a5700 0 -- 172.21.15.184:0/2197964705 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55c2b8f5f7a0 msgr2=0x7f2ba003fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:58.091 INFO:tasks.workunit.client.0.smithi184.stdout:100 2024-09-17T07:51:58.092 INFO:tasks.workunit.client.0.smithi184.stderr:++ seq -w 00 99 2024-09-17T07:51:58.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:58.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.00 2024-09-17T07:51:58.283 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:58.280+0000 7f10a7e90700 0 -- 172.21.15.184:0/2477696473 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55d22dcd8e00 msgr2=0x55d22dc8e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:51:58.285 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:58.291 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:58.291 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.01 2024-09-17T07:51:58.470 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:58.468+0000 7f75486f4700 0 -- 172.21.15.184:0/4065246358 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55e70f6e8fc0 msgr2=0x55e70f6e8540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:51:58.471 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:58.476 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:58.477 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.02 2024-09-17T07:51:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:58.668+0000 7fe7d5467700 0 -- 172.21.15.184:0/4032531799 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fe7b0008980 msgr2=0x7fe7b000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:58.674 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:58.680 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:58.680 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.03 2024-09-17T07:51:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:58.856+0000 7f4f1f39b700 0 -- 172.21.15.184:0/573332922 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f4f04008980 msgr2=0x7f4f0400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:51:58.861 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.04 2024-09-17T07:51:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:59.036+0000 7f1c4b084700 0 -- 172.21.15.184:0/3851075150 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f1c30008980 msgr2=0x7f1c3000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:59.041 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.05 2024-09-17T07:51:59.227 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:59.224+0000 7f7b30364700 0 -- 172.21.15.184:0/3910671127 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f7b14008af0 msgr2=0x7f7b1400af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:59.228 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:59.231 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:59.232 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.06 2024-09-17T07:51:59.395 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:59.391+0000 7f453bfa7700 0 -- 172.21.15.184:0/3936349730 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f4520008980 msgr2=0x7f452000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:59.396 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:59.401 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:59.401 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.07 2024-09-17T07:51:59.797 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:51:59.791+0000 7fa7b7cbe700 0 -- 172.21.15.184:0/568225716 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fa79c008980 msgr2=0x7fa79c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:51:59.809 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:51:59.814 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:51:59.814 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.08 2024-09-17T07:52:00.000 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:00.005 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:00.005 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.09 2024-09-17T07:52:00.191 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:00.187+0000 7f8ba6862700 0 -- 172.21.15.184:0/3516256259 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55c4a3667b40 msgr2=0x55c4a363f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:00.192 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:00.198 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:00.198 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.10 2024-09-17T07:52:00.371 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:00.367+0000 7fe0c0991700 0 -- 172.21.15.184:0/2064698409 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fe0a4008980 msgr2=0x7fe0a400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:00.372 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:00.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:00.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.11 2024-09-17T07:52:00.552 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:00.547+0000 7f1967be4700 0 -- 172.21.15.184:0/190468662 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f194c008980 msgr2=0x7f194c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:00.553 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:00.557 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:00.557 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.12 2024-09-17T07:52:00.761 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:00.755+0000 7f963892f700 0 -- 172.21.15.184:0/4015961132 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55fcf9555580 msgr2=0x55fcf950a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:00.761 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:00.767 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:00.767 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.13 2024-09-17T07:52:00.935 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:00.931+0000 7f27a1953700 0 -- 172.21.15.184:0/3269571454 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f2780006760 msgr2=0x7f2780012870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:00.935 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:00.940 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:00.940 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.14 2024-09-17T07:52:01.131 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:01.127+0000 7f7f45f85700 0 -- 172.21.15.184:0/1279178674 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55919e925920 msgr2=0x55919e9476c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:01.132 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:01.137 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:01.137 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.15 2024-09-17T07:52:01.512 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:01.507+0000 7f8e9781b700 0 -- 172.21.15.184:0/2448601124 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f8e7c008980 msgr2=0x7f8e7c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:01.543 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:01.548 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:01.549 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.16 2024-09-17T07:52:01.735 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:01.731+0000 7f54111a3700 0 -- 172.21.15.184:0/2231103398 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f53ec006760 msgr2=0x7f53ec0129e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:01.735 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:01.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:01.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.17 2024-09-17T07:52:01.939 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:01.935+0000 7ff28c563700 0 -- 172.21.15.184:0/1785346963 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff26c006750 msgr2=0x7ff26c008bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:01.940 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:01.946 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:01.946 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.18 2024-09-17T07:52:02.125 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:02.129 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:02.129 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.19 2024-09-17T07:52:02.305 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:02.299+0000 7ff1f91db700 0 -- 172.21.15.184:0/4172154781 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff1d4008980 msgr2=0x7ff1d400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:02.307 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:02.312 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:02.312 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.20 2024-09-17T07:52:02.493 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:02.487+0000 7fb7d23d0700 0 -- 172.21.15.184:0/514530606 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fb7b8008980 msgr2=0x7fb7b800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:02.502 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:02.507 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:02.507 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.21 2024-09-17T07:52:02.674 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:02.671+0000 7f9e2e0b0700 0 -- 172.21.15.184:0/1544999183 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f9e14008980 msgr2=0x7f9e1400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:02.675 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:02.678 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:02.679 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.22 2024-09-17T07:52:02.851 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:02.847+0000 7f348f854700 0 -- 172.21.15.184:0/2533362927 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f346c008af0 msgr2=0x7f346c00af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:02.856 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:02.861 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:02.862 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.23 2024-09-17T07:52:03.049 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:03.043+0000 7f2258cb2700 0 -- 172.21.15.184:0/50846037 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f223c008980 msgr2=0x7f223c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:03.049 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:03.054 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:03.054 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.24 2024-09-17T07:52:03.238 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:03.231+0000 7fd055e88700 0 -- 172.21.15.184:0/2660416673 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x562291ca5dc0 msgr2=0x562291cccd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:03.239 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:03.245 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:03.245 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.25 2024-09-17T07:52:03.454 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:03.447+0000 7f16af0c8700 0 -- 172.21.15.184:0/586193241 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55ed928a5640 msgr2=0x55ed92883630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:03.454 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:03.459 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:03.460 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.26 2024-09-17T07:52:03.637 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:03.631+0000 7ff5823ed700 0 -- 172.21.15.184:0/4049942331 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff568008980 msgr2=0x7ff56800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:03.639 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:03.644 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:03.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.27 2024-09-17T07:52:03.820 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:03.815+0000 7ff0a59e2700 0 -- 172.21.15.184:0/1901241463 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff07c005f00 msgr2=0x7ff07c008dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:03.820 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:03.825 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:03.825 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.28 2024-09-17T07:52:03.993 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:03.987+0000 7fc833a73700 0 -- 172.21.15.184:0/3186931809 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fc818008980 msgr2=0x7fc81800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:03.993 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:03.998 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:03.998 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.29 2024-09-17T07:52:04.172 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:04.167+0000 7f022019e700 0 -- 172.21.15.184:0/1829001676 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f0204008980 msgr2=0x7f020400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:04.174 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:04.179 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:04.179 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.30 2024-09-17T07:52:04.363 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:04.359+0000 7f859f94f700 0 -- 172.21.15.184:0/1419366918 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55ecfd2bc200 msgr2=0x55ecfd271660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:04.363 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:04.368 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:04.368 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.31 2024-09-17T07:52:04.555 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:04.551+0000 7fa168ac1700 0 -- 172.21.15.184:0/293219865 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x555b461a92e0 msgr2=0x555b46184f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:04.556 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:04.560 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:04.560 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.32 2024-09-17T07:52:04.737 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:04.731+0000 7fb35e370700 0 -- 172.21.15.184:0/4106098264 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55576e159ce0 msgr2=0x55576e1305a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:04.739 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:04.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:04.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.33 2024-09-17T07:52:04.928 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:04.923+0000 7f626341d700 0 -- 172.21.15.184:0/769363383 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f6248008980 msgr2=0x7f624800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:04.930 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:04.935 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:04.935 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.34 2024-09-17T07:52:05.112 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:05.107+0000 7ff99e1c0700 0 -- 172.21.15.184:0/745615796 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff984008af0 msgr2=0x7ff98400af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:05.112 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:05.117 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:05.118 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.35 2024-09-17T07:52:05.285 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:05.279+0000 7f8b7998d700 0 -- 172.21.15.184:0/1564838488 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f8b540060e0 msgr2=0x7f8b54008590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:05.511 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:05.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:05.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.36 2024-09-17T07:52:05.674 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:05.671+0000 7f6221968700 0 -- 172.21.15.184:0/3559024037 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f620403a6f0 msgr2=0x7f620403cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:05.694 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:05.699 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:05.699 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.37 2024-09-17T07:52:05.884 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:05.879+0000 7f43ec03d700 0 -- 172.21.15.184:0/775135890 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f43d0006730 msgr2=0x7f43d0012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:05.884 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:05.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:05.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.38 2024-09-17T07:52:06.063 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:06.059+0000 7f3540e14700 0 -- 172.21.15.184:0/3170352236 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5599f4b12050 msgr2=0x5599f4ac8470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:06.065 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:06.070 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:06.070 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.39 2024-09-17T07:52:06.239 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:06.235+0000 7f199782b700 0 -- 172.21.15.184:0/4013245741 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55e7b1ef4280 msgr2=0x55e7b1f0bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:06.252 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:06.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:06.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.40 2024-09-17T07:52:06.441 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:06.435+0000 7f18d649b700 0 -- 172.21.15.184:0/2275994899 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55ca8637f650 msgr2=0x55ca863c9280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:06.443 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:06.447 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:06.447 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.41 2024-09-17T07:52:06.613 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:06.607+0000 7f398a9d3700 0 -- 172.21.15.184:0/1699517826 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f396c03a620 msgr2=0x7f396c03ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:06.636 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:06.642 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:06.642 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.42 2024-09-17T07:52:06.815 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:06.811+0000 7f176886e700 0 -- 172.21.15.184:0/1147853298 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f174c008980 msgr2=0x7f174c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:06.815 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:06.820 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:06.820 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.43 2024-09-17T07:52:07.003 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:06.999+0000 7fd6eb6b4700 0 -- 172.21.15.184:0/321724118 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fd6d0008af0 msgr2=0x7fd6d000af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:07.003 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:07.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:07.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.44 2024-09-17T07:52:07.186 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:07.179+0000 7fecc8d1a700 0 -- 172.21.15.184:0/2709277449 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7feca0006750 msgr2=0x7feca0008bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:07.187 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:07.192 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:07.192 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.45 2024-09-17T07:52:07.364 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:07.359+0000 7f3f07c3d700 0 -- 172.21.15.184:0/882384245 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55b1e6519380 msgr2=0x55b1e64cf770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:07.365 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:07.370 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:07.370 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.46 2024-09-17T07:52:07.534 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:07.531+0000 7fb58ea3b700 0 -- 172.21.15.184:0/3020841051 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55a79ce9b650 msgr2=0x55a79ceb2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:07.545 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:07.550 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:07.550 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.47 2024-09-17T07:52:07.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:07.727+0000 7f1e92634700 0 -- 172.21.15.184:0/312103536 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55b41ce27ff0 msgr2=0x55b41ce70a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:07.732 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:07.736 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:07.736 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.48 2024-09-17T07:52:07.919 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:07.915+0000 7f42562dc700 0 -- 172.21.15.184:0/1757450381 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f42300060e0 msgr2=0x7f4230008590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:07.920 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:07.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:07.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.49 2024-09-17T07:52:08.108 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:08.103+0000 7f79a989a700 0 -- 172.21.15.184:0/698726590 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f7990006730 msgr2=0x7f7990012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:08.109 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:08.115 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:08.115 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.50 2024-09-17T07:52:08.303 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:08.299+0000 7eff76690700 0 -- 172.21.15.184:0/2090944602 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55d880437000 msgr2=0x55d8804353a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:08.305 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:08.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:08.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.51 2024-09-17T07:52:08.511 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:08.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:08.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.52 2024-09-17T07:52:08.694 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:08.687+0000 7f607bcd0700 0 -- 172.21.15.184:0/2208477704 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f6060008980 msgr2=0x7f606000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:08.694 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:08.699 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:08.699 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.53 2024-09-17T07:52:08.891 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:08.887+0000 7f4c0ad57700 0 -- 172.21.15.184:0/75487922 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f4bf0008980 msgr2=0x7f4bf000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:08.891 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:08.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:08.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.54 2024-09-17T07:52:09.065 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:09.059+0000 7fb437be3700 0 -- 172.21.15.184:0/476697208 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fb41c03a610 msgr2=0x7fb41c03c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:09.083 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:09.088 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:09.088 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.55 2024-09-17T07:52:09.279 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:09.275+0000 7ffa18d55700 0 -- 172.21.15.184:0/1800756091 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff9f0006750 msgr2=0x7ff9f0008bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:09.279 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:09.283 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:09.283 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.56 2024-09-17T07:52:09.485 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:09.479+0000 7f3cdf37f700 0 -- 172.21.15.184:0/880686638 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f3cc003a7c0 msgr2=0x7f3cc003cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:09.508 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:09.513 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:09.513 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.57 2024-09-17T07:52:09.719 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:09.715+0000 7f2b23406700 0 -- 172.21.15.184:0/152455185 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f2b00006730 msgr2=0x7f2b00012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:09.721 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:09.726 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:09.726 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.58 2024-09-17T07:52:09.914 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:09.907+0000 7f617da8a700 0 -- 172.21.15.184:0/2152904589 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f6164008980 msgr2=0x7f616400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:09.914 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:09.919 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:09.919 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.59 2024-09-17T07:52:10.082 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:10.079+0000 7f5fd4b13700 0 -- 172.21.15.184:0/2824689259 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f5fb8006730 msgr2=0x7f5fb8012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:10.083 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:10.087 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:10.088 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.60 2024-09-17T07:52:10.275 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:10.271+0000 7f8dc6fd0700 0 -- 172.21.15.184:0/1439046541 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f8dac008980 msgr2=0x7f8dac00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:10.276 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:10.281 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:10.281 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.61 2024-09-17T07:52:10.483 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:10.479+0000 7fe559859700 0 -- 172.21.15.184:0/1018755795 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fe540006730 msgr2=0x7fe540012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:10.484 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:10.489 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:10.489 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.62 2024-09-17T07:52:10.691 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:10.687+0000 7f1d0d63d700 0 -- 172.21.15.184:0/1797176486 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5570577cdfb0 msgr2=0x5570577cede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:10.692 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:10.698 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:10.698 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.63 2024-09-17T07:52:10.879 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:10.875+0000 7fc7a8052700 0 -- 172.21.15.184:0/697106269 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fc78c008980 msgr2=0x7fc78c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:10.879 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:10.884 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:10.884 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.64 2024-09-17T07:52:11.067 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:11.063+0000 7fca0f148700 0 -- 172.21.15.184:0/3007853162 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fc9f4008980 msgr2=0x7fc9f400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:11.067 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:11.073 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:11.073 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.65 2024-09-17T07:52:11.248 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:11.243+0000 7fbc3ca14700 0 -- 172.21.15.184:0/1434952509 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fbc20008980 msgr2=0x7fbc2000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:11.248 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:11.253 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:11.253 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.66 2024-09-17T07:52:11.436 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:11.431+0000 7f036696b700 0 -- 172.21.15.184:0/2638146418 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f034c006730 msgr2=0x7f034c012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:11.437 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:11.441 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:11.441 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.67 2024-09-17T07:52:11.613 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:11.607+0000 7f55438a2700 0 -- 172.21.15.184:0/4161369907 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f551c008980 msgr2=0x7f551c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:11.613 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:11.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:11.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.68 2024-09-17T07:52:11.793 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:11.787+0000 7f4ab90c8700 0 -- 172.21.15.184:0/2398362973 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f4a94008980 msgr2=0x7f4a9400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:11.793 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:11.798 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:11.799 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.69 2024-09-17T07:52:11.991 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:11.987+0000 7f005ae1e700 0 -- 172.21.15.184:0/1943031018 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f0038006760 msgr2=0x7f0038012870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:11.991 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:11.996 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:11.996 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.70 2024-09-17T07:52:12.172 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:12.167+0000 7f63f15fe700 0 -- 172.21.15.184:0/267505275 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f63cc008980 msgr2=0x7f63cc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:12.172 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:12.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:12.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.71 2024-09-17T07:52:12.345 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:12.339+0000 7f2bf248b700 0 -- 172.21.15.184:0/1255512581 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f2bd403a6f0 msgr2=0x7f2bd403cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:12.367 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:12.372 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:12.373 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.72 2024-09-17T07:52:12.557 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:12.551+0000 7f22d8be6700 0 -- 172.21.15.184:0/2014208763 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f22bc008980 msgr2=0x7f22bc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:12.558 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:12.563 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:12.563 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.73 2024-09-17T07:52:12.738 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:12.731+0000 7f70929ac700 0 -- 172.21.15.184:0/206806765 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f7078008980 msgr2=0x7f707800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:12.739 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:12.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:12.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.74 2024-09-17T07:52:12.905 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:12.899+0000 7f163fc0f700 0 -- 172.21.15.184:0/1487805919 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55735958eaa0 msgr2=0x5573595b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:12.906 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:12.909 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:12.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.75 2024-09-17T07:52:13.088 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:13.083+0000 7f70e15d4700 0 -- 172.21.15.184:0/1358882401 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f70c403a6f0 msgr2=0x7f70c403cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:13.100 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:13.104 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:13.104 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.76 2024-09-17T07:52:13.282 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:13.275+0000 7fb409286700 0 -- 172.21.15.184:0/1713661180 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55b418663000 msgr2=0x55b418619640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:13.284 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:13.289 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:13.289 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.77 2024-09-17T07:52:13.480 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:13.475+0000 7ff408967700 0 -- 172.21.15.184:0/2699771003 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff3e8005fa0 msgr2=0x7ff3e8008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:13.480 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:13.485 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:13.485 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.78 2024-09-17T07:52:13.664 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:13.659+0000 7fc35b423700 0 -- 172.21.15.184:0/3683024072 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fc340008980 msgr2=0x7fc34000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:13.666 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:13.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:13.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.79 2024-09-17T07:52:13.851 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:13.847+0000 7f0c0e3c5700 0 -- 172.21.15.184:0/881096621 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x557cbefa8f30 msgr2=0x557cbf051990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:13.855 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:13.859 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:13.859 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.80 2024-09-17T07:52:14.041 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:14.035+0000 7f221ff77700 0 -- 172.21.15.184:0/3240825684 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f21fc008980 msgr2=0x7f21fc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:14.043 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:14.047 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:14.048 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.81 2024-09-17T07:52:14.249 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:14.243+0000 7ff932a6a700 0 -- 172.21.15.184:0/643868670 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ff918008980 msgr2=0x7ff91800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:14.249 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:14.255 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:14.255 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.82 2024-09-17T07:52:14.442 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:14.439+0000 7fde0481f700 0 -- 172.21.15.184:0/282215120 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5639f555f090 msgr2=0x5639f5581200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:14.444 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:14.449 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:14.449 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.83 2024-09-17T07:52:14.636 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:14.631+0000 7f2df5a46700 0 -- 172.21.15.184:0/194245543 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f2dd4008980 msgr2=0x7f2dd400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:14.637 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:14.643 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:14.643 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.84 2024-09-17T07:52:14.836 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:14.831+0000 7f07c6715700 0 -- 172.21.15.184:0/1633646337 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f07ac008980 msgr2=0x7f07ac00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:14.836 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:14.841 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:14.841 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.85 2024-09-17T07:52:15.053 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:15.047+0000 7f0da7615700 0 -- 172.21.15.184:0/2863069408 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x559a4c23cbe0 msgr2=0x559a4c285480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:15.062 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:15.067 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:15.067 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.86 2024-09-17T07:52:15.255 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:15.251+0000 7fb94f7fd700 0 -- 172.21.15.184:0/3977154673 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fb92c008980 msgr2=0x7fb92c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:15.255 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:15.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:15.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.87 2024-09-17T07:52:15.429 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:15.423+0000 7f73c55b6700 0 -- 172.21.15.184:0/1865489076 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f73a403a6f0 msgr2=0x7f73a403cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:15.443 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:15.448 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:15.448 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.88 2024-09-17T07:52:15.663 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:15.659+0000 7f635b1b6700 0 -- 172.21.15.184:0/4141293300 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f633c03a6f0 msgr2=0x7f633c03cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:15.685 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:15.690 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:15.690 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.89 2024-09-17T07:52:15.877 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:15.871+0000 7fdc02f63700 0 -- 172.21.15.184:0/3181825942 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x5606cfa8b850 msgr2=0x5606cfb2e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:15.881 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:15.886 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:15.886 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.90 2024-09-17T07:52:16.070 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:16.063+0000 7f0c163b0700 0 -- 172.21.15.184:0/2228731153 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5575e754c780 msgr2=0x5575e75017f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:16.070 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:16.075 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:16.075 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.91 2024-09-17T07:52:16.285 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:16.279+0000 7f3492170700 0 -- 172.21.15.184:0/3589850401 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x564fa89e7e80 msgr2=0x564fa8a30880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:16.287 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:16.291 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:16.291 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.92 2024-09-17T07:52:16.496 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:16.491+0000 7f0009609700 0 -- 172.21.15.184:0/2064793060 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7effe4008980 msgr2=0x7effe400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:16.498 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:16.503 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:16.503 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.93 2024-09-17T07:52:16.692 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:16.687+0000 7f27b0c69700 0 -- 172.21.15.184:0/3191822886 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f279003a7c0 msgr2=0x7f279003cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:16.711 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:16.717 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:16.717 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.94 2024-09-17T07:52:16.896 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:16.890+0000 7f96d394c700 0 -- 172.21.15.184:0/784514791 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f96b8006730 msgr2=0x7f96b8012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:16.896 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:16.901 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:16.901 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.95 2024-09-17T07:52:17.093 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:17.086+0000 7f4d942e1700 0 -- 172.21.15.184:0/543394744 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5636dea7f7c0 msgr2=0x5636dea367b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:17.094 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:17.099 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:17.100 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.96 2024-09-17T07:52:17.280 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:17.274+0000 7f18f67db700 0 -- 172.21.15.184:0/2318701476 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f18d803a6f0 msgr2=0x7f18d803cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:17.300 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:17.304 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:17.304 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.97 2024-09-17T07:52:17.499 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:17.494+0000 7fad60cb2700 0 -- 172.21.15.184:0/3633795859 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fad44008980 msgr2=0x7fad4400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:17.500 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:17.505 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:17.505 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.98 2024-09-17T07:52:17.681 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:17.674+0000 7f5096b09700 0 -- 172.21.15.184:0/1098114530 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55f633363600 msgr2=0x55f633406800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:17.697 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:17.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ for i in $(seq -w 00 99) 2024-09-17T07:52:17.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm image.99 2024-09-17T07:52:17.896 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:17.890+0000 7f7d5e38b700 0 -- 172.21.15.184:0/2394281763 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x555ea0edeb30 msgr2=0x555ea0f274c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:17.897 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:17.902 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_remove 2024-09-17T07:52:17.902 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing remove...' 2024-09-17T07:52:17.903 INFO:tasks.workunit.client.0.smithi184.stdout:testing remove... 2024-09-17T07:52:17.903 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:52:17.903 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.023 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.146 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.395 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.517 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.638 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.763 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:18.891 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.014 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.138 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.382 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.500 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.631 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:19.888 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:20.013 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:20.137 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd remove NOT_EXIST 2024-09-17T07:52:20.204 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 0% complete...failed. 2024-09-17T07:52:20.204 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: delete error: (2) No such file or directory 2024-09-17T07:52:20.209 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:52:20.209 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 1 -s 1 test1 2024-09-17T07:52:20.237 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:20.250 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:20.242+0000 7fe9fd60d4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:20.264 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:52:20.331 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:20.337 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:52:20.337 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:52:20.338 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:52:20.378 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:52:20.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-17T07:52:20.449 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:20.618 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:20.610+0000 7fd2eeee4700 0 -- 172.21.15.184:0/1862827911 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fd2d4008980 msgr2=0x7fd2d400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:20.619 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:20.624 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:52:20.624 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:52:20.624 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:52:20.667 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:52:20.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 1 -s 1 test1 2024-09-17T07:52:20.696 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:20.710 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:20.702+0000 7f10d91834c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:20.721 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados rm -p rbd test1.rbd 2024-09-17T07:52:20.768 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:52:20.818 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:52:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:52:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:52:20.867 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:52:20.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 0 ']' 2024-09-17T07:52:20.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-17T07:52:20.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test2@snap 2024-09-17T07:52:21.165 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:21.162+0000 7f2c5eb77700 0 --2- 172.21.15.184:0/3730640379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5612f5822dc0 0x5612f58138f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T07:52:21.838 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:52:21.852 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect test2@snap 2024-09-17T07:52:21.908 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2024-09-17T07:52:22.019 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p rbd rm rbd_children 2024-09-17T07:52:22.065 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm clone 2024-09-17T07:52:22.260 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:22.254+0000 7f2c23f12700 0 -- 172.21.15.184:0/2129805959 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f2c000066d0 msgr2=0x7f2c000127e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:22.261 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:22.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:52:22.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep clone 2024-09-17T07:52:22.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:52:22.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:52:22.309 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:52:22.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect test2@snap 2024-09-17T07:52:22.383 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm test2@snap 2024-09-17T07:52:22.835 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:52:22.856 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:23.072 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:23.066+0000 7fc310efd700 0 -- 172.21.15.184:0/2128435551 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55e0f66913a0 msgr2=0x55e0f666ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:23.073 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:23.077 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_migration 2024-09-17T07:52:23.077 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing migration...' 2024-09-17T07:52:23.077 INFO:tasks.workunit.client.0.smithi184.stdout:testing migration... 2024-09-17T07:52:23.078 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:52:23.078 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:23.202 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:23.329 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:23.454 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:23.583 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:23.707 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:23.832 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:23.958 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.083 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.210 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.337 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.466 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.586 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.712 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.839 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:24.962 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:25.087 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:25.217 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:25.344 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool create rbd2 8 2024-09-17T07:52:25.944 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'rbd2' already exists 2024-09-17T07:52:25.952 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd pool init rbd2 2024-09-17T07:52:28.172 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 1 -s 128M test1 2024-09-17T07:52:28.197 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:28.212 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:28.206+0000 7f45471064c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:28.229 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info test1 2024-09-17T07:52:28.229 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'format: 1' 2024-09-17T07:52:28.280 INFO:tasks.workunit.client.0.smithi184.stdout: format: 1 2024-09-17T07:52:28.280 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test1 --image-format 2 2024-09-17T07:52:28.421 INFO:tasks.workunit.client.0.smithi184.stderr:++ get_migration_state test1 2024-09-17T07:52:28.421 INFO:tasks.workunit.client.0.smithi184.stderr:++ local image=test1 2024-09-17T07:52:28.421 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd --format xml status test1 2024-09-17T07:52:28.421 INFO:tasks.workunit.client.0.smithi184.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-17T07:52:28.563 INFO:tasks.workunit.client.0.smithi184.stderr:+ test prepared = prepared 2024-09-17T07:52:28.563 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info test1 2024-09-17T07:52:28.563 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'format: 2' 2024-09-17T07:52:28.631 INFO:tasks.workunit.client.0.smithi184.stdout: format: 2 2024-09-17T07:52:28.632 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:52:28.692 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:28.686+0000 7feae37904c0 -1 librbd::image::PreRemoveRequest: 0x55aca0728860 validate_image_removal: image in migration state - not removing 2024-09-17T07:52:28.696 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 0% complete...failed. 2024-09-17T07:52:28.696 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: error: image still has watchers 2024-09-17T07:52:28.696 INFO:tasks.workunit.client.0.smithi184.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2024-09-17T07:52:28.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:52:28.701 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test1 2024-09-17T07:52:28.878 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:28.874+0000 7f831cefc700 0 -- 172.21.15.184:0/1107380839 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55ea9c5c3770 msgr2=0x55ea9c624c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:28.899 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:28.894+0000 7f831cefc700 0 -- 172.21.15.184:0/1107380839 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f82fc03aef0 msgr2=0x7f82fc03d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:28.934 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:28.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ get_migration_state test1 2024-09-17T07:52:28.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ local image=test1 2024-09-17T07:52:28.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd --format xml status test1 2024-09-17T07:52:28.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-17T07:52:29.044 INFO:tasks.workunit.client.0.smithi184.stderr:+ test executed = executed 2024-09-17T07:52:29.044 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 2024-09-17T07:52:29.424 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete...2024-09-17T07:52:29.418+0000 7f8265719700 0 -- 172.21.15.184:0/2077347680 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5576c92e5f40 msgr2=0x5576c93d5e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:29.437 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-17T07:52:29.430+0000 7f8265719700 0 -- 172.21.15.184:0/2077347680 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f824403ae20 msgr2=0x7f824403d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:29.454 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 100% complete...done. 2024-09-17T07:52:29.458 INFO:tasks.workunit.client.0.smithi184.stderr:+ get_migration_state test1 2024-09-17T07:52:29.458 INFO:tasks.workunit.client.0.smithi184.stderr:+ local image=test1 2024-09-17T07:52:29.459 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --format xml status test1 2024-09-17T07:52:29.459 INFO:tasks.workunit.client.0.smithi184.stderr:+ xmlstarlet sel -t -v //status/migration/state 2024-09-17T07:52:29.519 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:52:29.520 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info test1 2024-09-17T07:52:29.520 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'features: .*layering' 2024-09-17T07:52:29.579 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:52:29.579 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2024-09-17T07:52:29.766 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info test1 2024-09-17T07:52:29.767 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'features: .*layering' 2024-09-17T07:52:29.840 INFO:tasks.workunit.client.0.smithi184.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2024-09-17T07:52:29.841 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test1 2024-09-17T07:52:29.993 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:29.986+0000 7fd1a26d4700 0 -- 172.21.15.184:0/3954954611 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5621d8aa4f50 msgr2=0x5621d8b9a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:30.024 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:30.018+0000 7fd1a1ed3700 0 -- 172.21.15.184:0/3954954611 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fd178004be0 msgr2=0x7fd178006fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:30.033 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:30.037 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 2024-09-17T07:52:30.205 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:30.198+0000 7f34c779a700 0 -- 172.21.15.184:0/1526747181 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f34a8004be0 msgr2=0x7f34a8006fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:30.225 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete...2024-09-17T07:52:30.218+0000 7f34c779a700 0 -- 172.21.15.184:0/1526747181 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f34ac03aee0 msgr2=0x7f34ac03d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:30.259 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2024-09-17T07:52:30.264 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test1 rbd2/test1 2024-09-17T07:52:30.429 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:30.422+0000 7f472f12d700 0 -- 172.21.15.184:0/1172932298 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x559d27bc6550 msgr2=0x559d27c276e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:30.445 INFO:tasks.workunit.client.0.smithi184.stderr:++ get_migration_state rbd2/test1 2024-09-17T07:52:30.445 INFO:tasks.workunit.client.0.smithi184.stderr:++ local image=rbd2/test1 2024-09-17T07:52:30.445 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd --format xml status rbd2/test1 2024-09-17T07:52:30.445 INFO:tasks.workunit.client.0.smithi184.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-17T07:52:30.586 INFO:tasks.workunit.client.0.smithi184.stderr:+ test prepared = prepared 2024-09-17T07:52:30.587 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:52:30.587 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:52:30.587 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:52:30.628 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:52:30.629 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd -p rbd2 ls 2024-09-17T07:52:30.629 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:52:30.672 INFO:tasks.workunit.client.0.smithi184.stdout:test1 2024-09-17T07:52:30.673 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test1 2024-09-17T07:52:30.828 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:30.822+0000 7fc02e279700 0 -- 172.21.15.184:0/2144001082 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55c227534fc0 msgr2=0x55c22762ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:30.838 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:30.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ get_migration_state rbd2/test1 2024-09-17T07:52:30.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ local image=rbd2/test1 2024-09-17T07:52:30.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd --format xml status rbd2/test1 2024-09-17T07:52:30.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-17T07:52:30.944 INFO:tasks.workunit.client.0.smithi184.stderr:+ test executed = executed 2024-09-17T07:52:30.944 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm rbd2/test1 2024-09-17T07:52:31.004 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:30.998+0000 7f986f774700 -1 librbd::image::PreRemoveRequest: 0x557c8f6a8550 validate_image_removal: image in migration state - not removing 2024-09-17T07:52:31.013 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 0% complete...failed. 2024-09-17T07:52:31.013 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: error: image still has watchers 2024-09-17T07:52:31.013 INFO:tasks.workunit.client.0.smithi184.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2024-09-17T07:52:31.018 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:52:31.018 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 2024-09-17T07:52:31.189 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-17T07:52:31.182+0000 7fa64fea8700 0 -- 172.21.15.184:0/1253266912 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x562dbfceb800 msgr2=0x562dbfd4ce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:31.216 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 100% complete...done. 2024-09-17T07:52:31.221 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace create rbd2/ns1 2024-09-17T07:52:31.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace create rbd2/ns2 2024-09-17T07:52:31.314 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2024-09-17T07:52:31.475 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:31.466+0000 7f103a173700 0 -- 172.21.15.184:0/1024439407 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f1014004b40 msgr2=0x7f1014006f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:31.487 INFO:tasks.workunit.client.0.smithi184.stderr:++ get_migration_state rbd2/ns1/test1 2024-09-17T07:52:31.488 INFO:tasks.workunit.client.0.smithi184.stderr:++ local image=rbd2/ns1/test1 2024-09-17T07:52:31.488 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd --format xml status rbd2/ns1/test1 2024-09-17T07:52:31.488 INFO:tasks.workunit.client.0.smithi184.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-17T07:52:31.630 INFO:tasks.workunit.client.0.smithi184.stderr:+ test prepared = prepared 2024-09-17T07:52:31.630 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute rbd2/test1 2024-09-17T07:52:31.749 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:31.742+0000 7fb2a8597700 0 -- 172.21.15.184:0/4288495394 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fb28803ae20 msgr2=0x7fb28803d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:31.967 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:31.972 INFO:tasks.workunit.client.0.smithi184.stderr:++ get_migration_state rbd2/ns1/test1 2024-09-17T07:52:31.972 INFO:tasks.workunit.client.0.smithi184.stderr:++ local image=rbd2/ns1/test1 2024-09-17T07:52:31.972 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd --format xml status rbd2/ns1/test1 2024-09-17T07:52:31.973 INFO:tasks.workunit.client.0.smithi184.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-17T07:52:32.083 INFO:tasks.workunit.client.0.smithi184.stderr:+ test executed = executed 2024-09-17T07:52:32.083 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit rbd2/test1 2024-09-17T07:52:32.234 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-17T07:52:32.226+0000 7fb942e0a700 0 -- 172.21.15.184:0/166895505 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x555f82ce4f40 msgr2=0x555f82dd2b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:32.249 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 100% complete...done. 2024-09-17T07:52:32.255 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2024-09-17T07:52:32.414 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:32.406+0000 7f686221e700 0 -- 172.21.15.184:0/1538412347 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x565431c03120 msgr2=0x565431ca3f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:32.428 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute rbd2/ns2/test1 2024-09-17T07:52:32.549 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:32.542+0000 7fd726785700 0 -- 172.21.15.184:0/531427982 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55f0d509fad0 msgr2=0x55f0d50a1eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:32.571 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:32.566+0000 7fd726785700 0 -- 172.21.15.184:0/531427982 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fd70803ae20 msgr2=0x7fd70803d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:32.577 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:32.581 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit rbd2/ns2/test1 2024-09-17T07:52:32.738 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:32.730+0000 7f6285d94700 0 -- 172.21.15.184:0/2311699515 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x56506cd1a690 msgr2=0x56506cd1ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:32.753 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:32.746+0000 7f6286595700 0 -- 172.21.15.184:0/2311699515 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x56506ccaea60 msgr2=0x56506cccccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:32.775 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2024-09-17T07:52:32.780 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M test1 2024-09-17T07:52:32.822 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:32.814+0000 7fa4177684c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:32.836 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test1 --data-pool rbd2 2024-09-17T07:52:32.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info test1 2024-09-17T07:52:32.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'data_pool: rbd2' 2024-09-17T07:52:33.031 INFO:tasks.workunit.client.0.smithi184.stdout: data_pool: rbd2 2024-09-17T07:52:33.031 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test1 2024-09-17T07:52:33.188 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:33.182+0000 7f16bc5bb700 0 -- 172.21.15.184:0/3651720266 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f16a0008af0 msgr2=0x7f16a000af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:33.219 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:33.214+0000 7f16bc5bb700 0 -- 172.21.15.184:0/3651720266 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f169c03ae20 msgr2=0x7f169c03d200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:33.235 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:33.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 2024-09-17T07:52:33.414 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... 2024-09-17T07:52:33.406+0000 7f67612f8700 0 -- 172.21.15.184:0/4036231124 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f673c008980 msgr2=0x7f673c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:33.426 INFO:tasks.workunit.client.0.smithi184.stderr:Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-17T07:52:33.418+0000 7f67612f8700 0 -- 172.21.15.184:0/4036231124 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f674403acc0 msgr2=0x7f674403d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:33.440 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 100% complete...done. 2024-09-17T07:52:33.444 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test1 2024-09-17T07:52:33.595 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd trash mv test1 2024-09-17T07:52:33.596 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv test1 2024-09-17T07:52:33.655 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:33.650+0000 7f43ae7384c0 -1 librbd::api::Trash: move: cannot move migrating image to trash 2024-09-17T07:52:33.658 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: deferred delete error: (16) Device or resource busy 2024-09-17T07:52:33.663 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:52:33.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls -a 2024-09-17T07:52:33.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ cut -d ' ' -f 1 2024-09-17T07:52:33.708 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=19e67a7c2b6f 2024-09-17T07:52:33.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd trash rm 19e67a7c2b6f 2024-09-17T07:52:33.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash rm 19e67a7c2b6f 2024-09-17T07:52:33.762 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:33.754+0000 7f8952308700 -1 librbd::image::RefreshRequest: image being migrated 2024-09-17T07:52:33.762 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:33.754+0000 7f8952308700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2024-09-17T07:52:33.762 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:33.754+0000 7f8951b07700 -1 librbd::ImageState: 0x7f892c04def0 failed to open image: (30) Read-only file system 2024-09-17T07:52:33.762 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:33.754+0000 7f8933fff700 -1 librbd::image::RemoveRequest: 0x7f892c000b80 handle_open_image: error opening image: (30) Read-only file system 2024-09-17T07:52:33.765 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: remove error: (30) Read-only file system 2024-09-17T07:52:33.766 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 0% complete...failed. 2024-09-17T07:52:33.770 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:52:33.770 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd trash restore 19e67a7c2b6f 2024-09-17T07:52:33.771 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash restore 19e67a7c2b6f 2024-09-17T07:52:33.808 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: restore error: (22) Invalid argument 2024-09-17T07:52:33.808 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:33.802+0000 7fc4002f54c0 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2024-09-17T07:52:33.812 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:52:33.812 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test1 2024-09-17T07:52:33.969 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete...2024-09-17T07:52:33.962+0000 7fef6ec4a700 0 -- 172.21.15.184:0/2338272335 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fef48004be0 msgr2=0x7fef48006fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:33.992 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-17T07:52:33.986+0000 7fef6f44b700 0 -- 172.21.15.184:0/2338272335 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55a48a4fa770 msgr2=0x55a48a55b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:34.018 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 100% complete...done. 2024-09-17T07:52:34.024 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd remove test1 2024-09-17T07:52:34.192 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-17T07:52:34.197 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/dev/urandom bs=1M count=1 2024-09-17T07:52:34.197 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd --image-format 2 import - test1 2024-09-17T07:52:34.284 INFO:tasks.workunit.client.0.smithi184.stderr:1+0 records in 2024-09-17T07:52:34.284 INFO:tasks.workunit.client.0.smithi184.stderr:1+0 records out 2024-09-17T07:52:34.285 INFO:tasks.workunit.client.0.smithi184.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0862236 s, 12.2 MB/s 2024-09-17T07:52:34.346 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 100% complete...done. 2024-09-17T07:52:34.352 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd export test1 - 2024-09-17T07:52:34.352 INFO:tasks.workunit.client.0.smithi184.stderr:++ md5sum 2024-09-17T07:52:34.410 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:52:34.418 INFO:tasks.workunit.client.0.smithi184.stderr:+ md5sum='500bc75a2cdf0b0aa1df87cd1d84dd97 -' 2024-09-17T07:52:34.418 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@snap1 2024-09-17T07:52:35.186 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:52:35.199 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect test1@snap1 2024-09-17T07:52:35.262 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@snap2 2024-09-17T07:52:36.196 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:52:36.209 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2024-09-17T07:52:36.344 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2024-09-17T07:52:36.659 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v1 2024-09-17T07:52:36.659 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'parent: rbd/test1@snap1' 2024-09-17T07:52:36.719 INFO:tasks.workunit.client.0.smithi184.stdout: parent: rbd/test1@snap1 2024-09-17T07:52:36.720 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v2 2024-09-17T07:52:36.720 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'parent: rbd/test1@snap2' 2024-09-17T07:52:36.792 INFO:tasks.workunit.client.0.smithi184.stdout: parent: rbd/test1@snap2 2024-09-17T07:52:36.792 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v2 2024-09-17T07:52:36.793 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'op_features: clone-child' 2024-09-17T07:52:36.864 INFO:tasks.workunit.client.0.smithi184.stdout: op_features: clone-child 2024-09-17T07:52:36.866 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd export clone_v1 - 2024-09-17T07:52:36.866 INFO:tasks.workunit.client.0.smithi184.stderr:++ md5sum 2024-09-17T07:52:36.940 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:52:36.978 INFO:tasks.workunit.client.0.smithi184.stderr:+ test '500bc75a2cdf0b0aa1df87cd1d84dd97 -' = '500bc75a2cdf0b0aa1df87cd1d84dd97 -' 2024-09-17T07:52:36.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd export clone_v2 - 2024-09-17T07:52:36.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ md5sum 2024-09-17T07:52:37.019 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:52:37.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ test '500bc75a2cdf0b0aa1df87cd1d84dd97 -' = '500bc75a2cdf0b0aa1df87cd1d84dd97 -' 2024-09-17T07:52:37.026 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd children test1@snap1 2024-09-17T07:52:37.104 INFO:tasks.workunit.client.0.smithi184.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2024-09-17T07:52:37.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd children test1@snap2 2024-09-17T07:52:37.171 INFO:tasks.workunit.client.0.smithi184.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2024-09-17T07:52:37.172 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test1 rbd2/test2 2024-09-17T07:52:37.331 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:37.326+0000 7f5dbe76d700 0 -- 172.21.15.184:0/3824823882 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f5da4008980 msgr2=0x7f5da400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:39.206 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:39.198+0000 7f5dbe76d700 0 -- 172.21.15.184:0/3824823882 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f5da003ad90 msgr2=0x7f5da003d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:39.342 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v1 2024-09-17T07:52:39.343 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2024-09-17T07:52:39.449 INFO:tasks.workunit.client.0.smithi184.stdout: parent: rbd2/test2@snap1 2024-09-17T07:52:39.449 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v2 2024-09-17T07:52:39.450 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2024-09-17T07:52:39.550 INFO:tasks.workunit.client.0.smithi184.stdout: parent: rbd2/test2@snap2 2024-09-17T07:52:39.551 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v2 2024-09-17T07:52:39.551 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'op_features: clone-child' 2024-09-17T07:52:39.657 INFO:tasks.workunit.client.0.smithi184.stdout: op_features: clone-child 2024-09-17T07:52:39.658 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd children rbd2/test2@snap1 2024-09-17T07:52:39.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2024-09-17T07:52:39.764 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd children rbd2/test2@snap2 2024-09-17T07:52:39.849 INFO:tasks.workunit.client.0.smithi184.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2024-09-17T07:52:39.849 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test1 2024-09-17T07:52:39.995 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:40.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd migration commit test1 2024-09-17T07:52:40.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 2024-09-17T07:52:40.134 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: the image has descendants: 2024-09-17T07:52:40.134 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v1 2024-09-17T07:52:40.134 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v2 2024-09-17T07:52:40.134 INFO:tasks.workunit.client.0.smithi184.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-17T07:52:40.134 INFO:tasks.workunit.client.0.smithi184.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2024-09-17T07:52:40.140 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:52:40.140 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 --force 2024-09-17T07:52:40.269 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: the image has descendants: 2024-09-17T07:52:40.270 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v1 2024-09-17T07:52:40.270 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v2 2024-09-17T07:52:40.270 INFO:tasks.workunit.client.0.smithi184.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-17T07:52:40.270 INFO:tasks.workunit.client.0.smithi184.stderr:Proceeding anyway due to force flag set. 2024-09-17T07:52:40.298 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:40.290+0000 7f5d718d3700 0 -- 172.21.15.184:0/1269426672 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55979720c2a0 msgr2=0x55979720e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:40.315 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:40.310+0000 7f5d718d3700 0 -- 172.21.15.184:0/1269426672 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f5d5403ad90 msgr2=0x7f5d5403d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:42.287 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 100% complete...done. 2024-09-17T07:52:42.293 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd export clone_v1 - 2024-09-17T07:52:42.293 INFO:tasks.workunit.client.0.smithi184.stderr:++ md5sum 2024-09-17T07:52:42.373 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:52:42.375 INFO:tasks.workunit.client.0.smithi184.stderr:+ test '500bc75a2cdf0b0aa1df87cd1d84dd97 -' = '500bc75a2cdf0b0aa1df87cd1d84dd97 -' 2024-09-17T07:52:42.376 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd export clone_v2 - 2024-09-17T07:52:42.376 INFO:tasks.workunit.client.0.smithi184.stderr:++ md5sum 2024-09-17T07:52:42.451 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:52:42.457 INFO:tasks.workunit.client.0.smithi184.stderr:+ test '500bc75a2cdf0b0aa1df87cd1d84dd97 -' = '500bc75a2cdf0b0aa1df87cd1d84dd97 -' 2024-09-17T07:52:42.457 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare rbd2/test2 test1 2024-09-17T07:52:42.627 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:42.621+0000 7f58bb040700 0 -- 172.21.15.184:0/2472660881 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x555abd95f0b0 msgr2=0x555abda4fc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:44.228 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:44.221+0000 7f58bb040700 0 -- 172.21.15.184:0/2472660881 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f589c03aef0 msgr2=0x7f589c03d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:44.366 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v1 2024-09-17T07:52:44.367 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'parent: rbd/test1@snap1' 2024-09-17T07:52:44.475 INFO:tasks.workunit.client.0.smithi184.stdout: parent: rbd/test1@snap1 2024-09-17T07:52:44.475 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v2 2024-09-17T07:52:44.476 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'parent: rbd/test1@snap2' 2024-09-17T07:52:44.585 INFO:tasks.workunit.client.0.smithi184.stdout: parent: rbd/test1@snap2 2024-09-17T07:52:44.585 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info clone_v2 2024-09-17T07:52:44.586 INFO:tasks.workunit.client.0.smithi184.stderr:+ fgrep 'op_features: clone-child' 2024-09-17T07:52:44.689 INFO:tasks.workunit.client.0.smithi184.stdout: op_features: clone-child 2024-09-17T07:52:44.690 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd children test1@snap1 2024-09-17T07:52:44.801 INFO:tasks.workunit.client.0.smithi184.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2024-09-17T07:52:44.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd children test1@snap2 2024-09-17T07:52:44.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2024-09-17T07:52:44.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test1 2024-09-17T07:52:45.293 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:45.285+0000 7f234d2d3700 0 -- 172.21.15.184:0/1314712306 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55d20aa66750 msgr2=0x55d20ab58600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:45.299 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:45.304 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd migration commit test1 2024-09-17T07:52:45.304 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 2024-09-17T07:52:45.441 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: the image has descendants: 2024-09-17T07:52:45.441 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v1 2024-09-17T07:52:45.441 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v2 2024-09-17T07:52:45.441 INFO:tasks.workunit.client.0.smithi184.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-17T07:52:45.441 INFO:tasks.workunit.client.0.smithi184.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2024-09-17T07:52:45.445 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:52:45.445 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration commit test1 --force 2024-09-17T07:52:45.589 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:45.581+0000 7fd01b296700 0 -- 172.21.15.184:0/3346302703 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x564d946f5cd0 msgr2=0x564d9475cf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:45.589 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: the image has descendants: 2024-09-17T07:52:45.589 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v1 2024-09-17T07:52:45.589 INFO:tasks.workunit.client.0.smithi184.stderr: rbd/clone_v2 2024-09-17T07:52:45.589 INFO:tasks.workunit.client.0.smithi184.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-17T07:52:45.589 INFO:tasks.workunit.client.0.smithi184.stderr:Proceeding anyway due to force flag set. 2024-09-17T07:52:45.812 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:45.805+0000 7fd01b296700 0 -- 172.21.15.184:0/3346302703 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fcff4004bb0 msgr2=0x7fcffc03ff30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:47.293 INFO:tasks.workunit.client.0.smithi184.stderr: Commit image migration: 100% complete...done. 2024-09-17T07:52:47.300 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd export clone_v1 - 2024-09-17T07:52:47.300 INFO:tasks.workunit.client.0.smithi184.stderr:++ md5sum 2024-09-17T07:52:47.373 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:52:47.381 INFO:tasks.workunit.client.0.smithi184.stderr:+ test '500bc75a2cdf0b0aa1df87cd1d84dd97 -' = '500bc75a2cdf0b0aa1df87cd1d84dd97 -' 2024-09-17T07:52:47.382 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd export clone_v2 - 2024-09-17T07:52:47.382 INFO:tasks.workunit.client.0.smithi184.stderr:++ md5sum 2024-09-17T07:52:47.459 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:52:47.465 INFO:tasks.workunit.client.0.smithi184.stderr:+ test '500bc75a2cdf0b0aa1df87cd1d84dd97 -' = '500bc75a2cdf0b0aa1df87cd1d84dd97 -' 2024-09-17T07:52:47.465 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd remove clone_v1 2024-09-17T07:52:47.653 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:47.649+0000 7f7a02dd3700 0 -- 172.21.15.184:0/229671092 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55ad271fd600 msgr2=0x55ad272a08b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:47.664 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:47.669 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd remove clone_v2 2024-09-17T07:52:47.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:47.829+0000 7fbea5ea7700 0 -- 172.21.15.184:0/864421295 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5587aae95850 msgr2=0x7fbe8803ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:48.071 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:48.075 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect test1@snap1 2024-09-17T07:52:48.149 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge test1 2024-09-17T07:52:50.181 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:52:50.196 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:52:50.352 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:50.349+0000 7f9465783700 0 -- 172.21.15.184:0/3911780471 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55f5cd37da00 msgr2=0x55f5cd4232e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:50.363 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:50.366 INFO:tasks.workunit.client.0.smithi184.stderr:+ for format in 1 2 2024-09-17T07:52:50.366 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-17T07:52:50.405 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:50.417 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:50.413+0000 7f8a9d2df4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:50.426 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-17T07:52:50.530 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:50.595 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:50.602 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:50.602 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:50.611 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test2 2024-09-17T07:52:50.935 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-17T07:52:50.933+0000 7fd5eb809700 0 -- 172.21.15.184:0/1427065245 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fd5cc03aea0 msgr2=0x7fd5cc03d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:50.970 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:50.965+0000 7fd5eb809700 0 -- 172.21.15.184:0/1427065245 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x561e5ec18890 msgr2=0x7fd5cc03fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:50.976 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 100% complete...done. 2024-09-17T07:52:50.981 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:51.035 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:51.041 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:51.041 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:51.048 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:51.128 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-17T07:52:51.132 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-17T07:52:51.161 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:51.173 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:51.169+0000 7fd70d8094c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:51.186 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-17T07:52:51.315 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:51.381 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:51.388 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:51.388 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:51.397 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test2 2024-09-17T07:52:51.558 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:51.553+0000 7f912fd35700 0 -- 172.21.15.184:0/4103174850 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x562557683b10 msgr2=0x562557685ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:51.586 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:51.581+0000 7f912f534700 0 -- 172.21.15.184:0/4103174850 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f9114008af0 msgr2=0x7f911400af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:51.599 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:51.604 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test2 2024-09-17T07:52:51.728 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-17T07:52:51.725+0000 7f39a1f65700 0 -- 172.21.15.184:0/68182715 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f3988008980 msgr2=0x7f398800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:51.761 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 100% complete...done. 2024-09-17T07:52:51.766 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:51.817 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:51.823 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:51.823 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:51.832 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:51.924 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-17T07:52:51.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-17T07:52:51.957 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:51.969 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:51.965+0000 7f7789d094c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:51.984 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2024-09-17T07:52:52.057 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:52.053+0000 7fa0e6e814c0 -1 librbd::image::CreateRequest: 0x556f693f1eb0 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2024-09-17T07:52:52.057 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:52.053+0000 7fa0e6e814c0 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2024-09-17T07:52:52.074 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: preparing migration failed: (2) No such file or directory 2024-09-17T07:52:52.080 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:52:52.080 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:52.136 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:52.141 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:52.141 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:52.151 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:52.235 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-17T07:52:52.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-17T07:52:52.265 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:52.275 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:52.273+0000 7fb08499f4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:52.286 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-17T07:52:52.403 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2024-09-17T07:52:52.473 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:52.481 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:52.481 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:52.491 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test2 2024-09-17T07:52:52.622 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-17T07:52:52.617+0000 7ff49740c700 0 -- 172.21.15.184:0/2410765757 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x5574d9e6efc0 msgr2=0x5574d9f647a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:52.630 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 100% complete...done. 2024-09-17T07:52:52.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:52.684 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:52.688 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:52.688 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:52.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:52.777 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-17T07:52:52.781 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-17T07:52:52.807 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image format 1 is deprecated 2024-09-17T07:52:52.819 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:52.817+0000 7fc6d65614c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:52:52.831 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-17T07:52:52.963 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort rbd2/test2 2024-09-17T07:52:53.095 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-17T07:52:53.093+0000 7f590ad85700 0 -- 172.21.15.184:0/4247490106 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f58f0008980 msgr2=0x7f58f000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:53.114 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 100% complete...done. 2024-09-17T07:52:53.119 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:53.182 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:53.187 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:53.187 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:53.196 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:53.289 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-17T07:52:53.293 INFO:tasks.workunit.client.0.smithi184.stderr:+ test 1 = 1 2024-09-17T07:52:53.293 INFO:tasks.workunit.client.0.smithi184.stderr:+ continue 2024-09-17T07:52:53.293 INFO:tasks.workunit.client.0.smithi184.stderr:+ for format in 1 2 2024-09-17T07:52:53.293 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-17T07:52:53.360 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-17T07:52:53.539 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:53.537+0000 7f895d715700 0 -- 172.21.15.184:0/406354526 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x561292b62e10 msgr2=0x561292b64100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:53.553 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:53.635 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:53.643 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:53.644 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:53.659 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test2 2024-09-17T07:52:53.877 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-17T07:52:53.873+0000 7fbedcf22700 0 -- 172.21.15.184:0/184001034 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x56101f0533a0 msgr2=0x56101f0b49a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:53.882 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 100% complete...done. 2024-09-17T07:52:53.887 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:53.950 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:53.955 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:53.955 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:53.970 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:54.154 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T07:52:54.149+0000 7f939ea43700 0 -- 172.21.15.184:0/1911412897 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f938003ae70 msgr2=0x7f938003d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:54.177 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:54.182 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-17T07:52:54.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-17T07:52:54.435 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:54.433+0000 7f9c9198e700 0 -- 172.21.15.184:0/1153894128 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f9c70008980 msgr2=0x7f9c7000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:54.446 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:54.528 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:54.537 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:54.537 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:54.549 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration execute test2 2024-09-17T07:52:54.706 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-17T07:52:54.701+0000 7fa60efbc700 0 -- 172.21.15.184:0/168732379 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55b7e291c050 msgr2=0x55b7e297aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:54.746 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:54.741+0000 7fa60e7bb700 0 -- 172.21.15.184:0/168732379 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fa5f4008980 msgr2=0x7fa5f400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:54.750 INFO:tasks.workunit.client.0.smithi184.stderr: Image migration: 100% complete...done. 2024-09-17T07:52:54.754 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test2 2024-09-17T07:52:54.944 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-17T07:52:54.941+0000 7fb9efc08700 0 -- 172.21.15.184:0/2136463396 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fb9d403ae70 msgr2=0x7fb9d403d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:54.968 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 100% complete...done. 2024-09-17T07:52:54.972 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:55.040 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:55.044 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:55.044 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:55.059 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:55.245 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T07:52:55.241+0000 7f31dd2db700 0 -- 172.21.15.184:0/2266662903 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55ce67821a00 msgr2=0x55ce678c7840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:55.254 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:55.259 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-17T07:52:55.328 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2024-09-17T07:52:55.455 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:55.453+0000 7f101fe424c0 -1 librbd::image::CreateRequest: 0x5643fcb5cca0 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2024-09-17T07:52:55.456 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:55.453+0000 7f101fe424c0 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2024-09-17T07:52:55.502 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: preparing migration failed: (2) No such file or directory 2024-09-17T07:52:55.507 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:52:55.507 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:55.579 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:55.586 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:55.586 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:55.600 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:55.790 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T07:52:55.785+0000 7fda54b71700 0 -- 172.21.15.184:0/3097120114 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x56372eae3280 msgr2=0x56372eafab30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:55.805 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:55.808 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-17T07:52:55.881 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-17T07:52:56.066 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:56.061+0000 7f8bce842700 0 -- 172.21.15.184:0/2219163548 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55a94d8cb360 msgr2=0x55a94d92ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:56.075 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2024-09-17T07:52:56.158 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:56.166 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:56.166 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:56.179 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test2 2024-09-17T07:52:56.350 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2024-09-17T07:52:56.355 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:56.420 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:56.424 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:56.424 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:56.439 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:56.643 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T07:52:56.641+0000 7f01d1f43700 0 -- 172.21.15.184:0/389066340 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55abffba9f10 msgr2=0x55abffc4cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:56.647 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:56.652 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-17T07:52:56.730 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-17T07:52:56.898 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:56.893+0000 7f2d89682700 0 -- 172.21.15.184:0/3812627580 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x556505ff9120 msgr2=0x5565060e6760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:56.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort rbd2/test2 2024-09-17T07:52:57.078 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2024-09-17T07:52:57.083 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:57.154 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:57.162 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:57.162 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:57.179 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:57.361 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T07:52:57.357+0000 7ff618809700 0 -- 172.21.15.184:0/1325219257 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x563e75d7b280 msgr2=0x563e75d92b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:52:57.370 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:57.375 INFO:tasks.workunit.client.0.smithi184.stderr:+ test 2 = 1 2024-09-17T07:52:57.375 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-17T07:52:57.444 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2024-09-17T07:52:57.624 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:52:57.621+0000 7f5907ead700 0 -- 172.21.15.184:0/2887483484 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x561c0c0e3be0 msgr2=0x561c0c0e5fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:57.634 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2024-09-17T07:52:57.711 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:57.718 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:57.718 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 125.004 bytes/sec: 125 KiB/s 2024-09-17T07:52:57.730 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd migration abort test2 2024-09-17T07:52:57.896 INFO:tasks.workunit.client.0.smithi184.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2024-09-17T07:52:57.901 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-17T07:52:57.964 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-17T07:52:57.968 INFO:tasks.workunit.client.0.smithi184.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T07:52:57.968 INFO:tasks.workunit.client.0.smithi184.stdout:elapsed: 0 ops: 1 ops/sec: 250.008 bytes/sec: 250 KiB/s 2024-09-17T07:52:57.982 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:52:58.193 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T07:52:58.189+0000 7f89c1ce4700 0 -- 172.21.15.184:0/1128294877 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f89a8008980 msgr2=0x7f89a800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:52:58.203 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:52:58.209 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:52:58.209 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:58.335 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:58.462 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:58.595 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:58.725 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:58.973 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:59.234 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:59.370 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:59.503 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:59.631 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:59.757 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:52:59.886 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:00.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:00.143 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:00.273 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:00.404 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:00.527 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2024-09-17T07:53:01.294 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'rbd2' does not exist 2024-09-17T07:53:01.302 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_config 2024-09-17T07:53:01.303 INFO:tasks.workunit.client.0.smithi184.stdout:testing config... 2024-09-17T07:53:01.303 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing config...' 2024-09-17T07:53:01.303 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:53:01.303 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:01.423 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:01.550 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:01.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:01.806 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:01.932 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.055 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.189 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.314 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.444 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.574 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.698 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.824 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:02.950 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:03.077 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:03.203 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:03.334 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:03.460 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:03.595 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config global set osd rbd_cache true 2024-09-17T07:53:03.595 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global set osd rbd_cache true 2024-09-17T07:53:03.626 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2024-09-17T07:53:03.628 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:03.628 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config global set global debug_ms 10 2024-09-17T07:53:03.628 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global set global debug_ms 10 2024-09-17T07:53:03.658 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: not rbd option: debug_ms 2024-09-17T07:53:03.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:03.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2024-09-17T07:53:03.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global set global rbd_UNKNOWN false 2024-09-17T07:53:03.688 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: invalid config key: rbd_UNKNOWN 2024-09-17T07:53:03.689 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:03.690 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2024-09-17T07:53:03.690 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global set global rbd_cache INVALID 2024-09-17T07:53:03.727 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2024-09-17T07:53:03.731 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:03.731 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global set global rbd_cache false 2024-09-17T07:53:03.776 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global set client rbd_cache true 2024-09-17T07:53:03.825 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global set client.123 rbd_cache false 2024-09-17T07:53:03.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global get global rbd_cache 2024-09-17T07:53:03.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^false$' 2024-09-17T07:53:03.920 INFO:tasks.workunit.client.0.smithi184.stdout:false 2024-09-17T07:53:03.921 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global get client rbd_cache 2024-09-17T07:53:03.921 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^true$' 2024-09-17T07:53:03.963 INFO:tasks.workunit.client.0.smithi184.stdout:true 2024-09-17T07:53:03.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global get client.123 rbd_cache 2024-09-17T07:53:03.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^false$' 2024-09-17T07:53:04.004 INFO:tasks.workunit.client.0.smithi184.stdout:false 2024-09-17T07:53:04.005 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2024-09-17T07:53:04.005 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2024-09-17T07:53:04.041 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: rbd_cache is not set 2024-09-17T07:53:04.046 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:04.047 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global list global 2024-09-17T07:53:04.047 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * false * global *$' 2024-09-17T07:53:04.088 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache false global 2024-09-17T07:53:04.089 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global list client 2024-09-17T07:53:04.089 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * true * client *$' 2024-09-17T07:53:04.127 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache true client 2024-09-17T07:53:04.127 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global list client.123 2024-09-17T07:53:04.127 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * false * client.123 *$' 2024-09-17T07:53:04.169 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache false client.123 2024-09-17T07:53:04.170 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global list client.UNKNOWN 2024-09-17T07:53:04.170 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * true * client *$' 2024-09-17T07:53:04.211 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache true client 2024-09-17T07:53:04.212 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global rm client rbd_cache 2024-09-17T07:53:04.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config global get client rbd_cache 2024-09-17T07:53:04.261 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global get client rbd_cache 2024-09-17T07:53:04.302 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: rbd_cache is not set 2024-09-17T07:53:04.307 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:04.308 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global list client 2024-09-17T07:53:04.308 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * false * global *$' 2024-09-17T07:53:04.350 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache false global 2024-09-17T07:53:04.351 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global rm client.123 rbd_cache 2024-09-17T07:53:04.393 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config global rm global rbd_cache 2024-09-17T07:53:04.447 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config pool set rbd rbd_cache true 2024-09-17T07:53:04.500 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config pool list rbd 2024-09-17T07:53:04.500 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * true * pool *$' 2024-09-17T07:53:04.540 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache true pool 2024-09-17T07:53:04.541 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config pool get rbd rbd_cache 2024-09-17T07:53:04.541 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^true$' 2024-09-17T07:53:04.585 INFO:tasks.workunit.client.0.smithi184.stdout:true 2024-09-17T07:53:04.585 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 1 test1 2024-09-17T07:53:04.621 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:04.617+0000 7f864fd8a4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:04.636 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config image list rbd/test1 2024-09-17T07:53:04.636 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * true * pool *$' 2024-09-17T07:53:04.696 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache true pool 2024-09-17T07:53:04.697 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config image set rbd/test1 rbd_cache false 2024-09-17T07:53:04.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config image list rbd/test1 2024-09-17T07:53:04.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * false * image *$' 2024-09-17T07:53:04.828 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache false image 2024-09-17T07:53:04.828 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config image get rbd/test1 rbd_cache 2024-09-17T07:53:04.828 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^false$' 2024-09-17T07:53:04.894 INFO:tasks.workunit.client.0.smithi184.stdout:false 2024-09-17T07:53:04.894 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config image remove rbd/test1 rbd_cache 2024-09-17T07:53:04.958 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2024-09-17T07:53:04.958 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config image get rbd/test1 rbd_cache 2024-09-17T07:53:05.006 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: rbd_cache is not set 2024-09-17T07:53:05.014 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:05.014 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config image list rbd/test1 2024-09-17T07:53:05.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * true * pool *$' 2024-09-17T07:53:05.078 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache true pool 2024-09-17T07:53:05.078 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config pool remove rbd rbd_cache 2024-09-17T07:53:05.130 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2024-09-17T07:53:05.130 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config pool get rbd rbd_cache 2024-09-17T07:53:05.169 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: rbd_cache is not set 2024-09-17T07:53:05.174 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:53:05.175 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd config pool list rbd 2024-09-17T07:53:05.175 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^rbd_cache * true * config *$' 2024-09-17T07:53:05.215 INFO:tasks.workunit.client.0.smithi184.stdout:rbd_cache true config 2024-09-17T07:53:05.216 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:53:05.280 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:53:05.284 INFO:tasks.workunit.client.0.smithi184.stderr:+ RBD_CREATE_ARGS= 2024-09-17T07:53:05.285 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_others 2024-09-17T07:53:05.285 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing import, export, resize, and snapshots...' 2024-09-17T07:53:05.285 INFO:tasks.workunit.client.0.smithi184.stdout:testing import, export, resize, and snapshots... 2024-09-17T07:53:05.286 INFO:tasks.workunit.client.0.smithi184.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2024-09-17T07:53:05.286 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:53:05.286 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:05.620 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:05.748 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:05.874 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:06.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:06.344 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:06.471 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:06.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:06.940 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.070 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.203 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.332 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.461 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:07.967 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:08.100 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:08.233 INFO:tasks.workunit.client.0.smithi184.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-17T07:53:08.235 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2024-09-17T07:53:08.236 INFO:tasks.workunit.client.0.smithi184.stderr:1+0 records in 2024-09-17T07:53:08.236 INFO:tasks.workunit.client.0.smithi184.stderr:1+0 records out 2024-09-17T07:53:08.236 INFO:tasks.workunit.client.0.smithi184.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000138749 s, 7.4 MB/s 2024-09-17T07:53:08.236 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2024-09-17T07:53:08.237 INFO:tasks.workunit.client.0.smithi184.stderr:10+0 records in 2024-09-17T07:53:08.237 INFO:tasks.workunit.client.0.smithi184.stderr:10+0 records out 2024-09-17T07:53:08.237 INFO:tasks.workunit.client.0.smithi184.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.000203006 s, 50.4 MB/s 2024-09-17T07:53:08.238 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2024-09-17T07:53:08.239 INFO:tasks.workunit.client.0.smithi184.stderr:70+1 records in 2024-09-17T07:53:08.239 INFO:tasks.workunit.client.0.smithi184.stderr:70+1 records out 2024-09-17T07:53:08.239 INFO:tasks.workunit.client.0.smithi184.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000547585 s, 132 MB/s 2024-09-17T07:53:08.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2024-09-17T07:53:08.241 INFO:tasks.workunit.client.0.smithi184.stderr:138+1 records in 2024-09-17T07:53:08.241 INFO:tasks.workunit.client.0.smithi184.stderr:138+1 records out 2024-09-17T07:53:08.241 INFO:tasks.workunit.client.0.smithi184.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.00068927 s, 206 MB/s 2024-09-17T07:53:08.242 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2024-09-17T07:53:08.243 INFO:tasks.workunit.client.0.smithi184.stderr:74+1 records in 2024-09-17T07:53:08.243 INFO:tasks.workunit.client.0.smithi184.stderr:74+1 records out 2024-09-17T07:53:08.243 INFO:tasks.workunit.client.0.smithi184.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.000527548 s, 144 MB/s 2024-09-17T07:53:08.243 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import /tmp/img1 testimg1 2024-09-17T07:53:08.286 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:08.281+0000 7f2e425da4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:08.401 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2024-09-17T07:53:08.406 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2024-09-17T07:53:08.458 INFO:tasks.workunit.client.0.smithi184.stderr: Resizing image: 100% complete...done. 2024-09-17T07:53:08.464 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img2 2024-09-17T07:53:08.609 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:08.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1 --snap=snap1 2024-09-17T07:53:09.205 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:53:09.213 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd resize testimg1 --size=128 2024-09-17T07:53:09.263 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2024-09-17T07:53:09.271 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:53:09.271 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2024-09-17T07:53:09.354 INFO:tasks.workunit.client.0.smithi184.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2024-09-17T07:53:09.360 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img3 2024-09-17T07:53:09.471 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:09.477 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg1 2024-09-17T07:53:09.477 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:09.525 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:09.526 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg1 2024-09-17T07:53:09.526 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:09.573 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:09.573 INFO:tasks.workunit.client.0.smithi184.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2024-09-17T07:53:09.574 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2024-09-17T07:53:09.711 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:09.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2024-09-17T07:53:09.794 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:53:09.800 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --size=1 testimg-diff1 2024-09-17T07:53:09.834 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:09.829+0000 7f558e8f54c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:09.847 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2024-09-17T07:53:10.212 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-09-17T07:53:10.221 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2024-09-17T07:53:10.296 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2024-09-17T07:53:10.303 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg1 2024-09-17T07:53:10.303 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:10.351 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:10.352 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg1 2024-09-17T07:53:10.352 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:10.399 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:10.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff1 2024-09-17T07:53:10.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:10.450 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:10.450 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-17T07:53:10.451 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:10.506 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:10.506 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2024-09-17T07:53:10.639 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:10.643 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg1 testimg3 2024-09-17T07:53:10.756 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:10.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2024-09-17T07:53:10.886 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:10.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2024-09-17T07:53:10.997 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:11.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg2 2024-09-17T07:53:11.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:11.050 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:11.051 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg3 2024-09-17T07:53:11.051 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:11.104 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:11.105 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff2 2024-09-17T07:53:11.105 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:11.162 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:11.163 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff3 2024-09-17T07:53:11.163 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:11.219 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:11.220 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep copy testimg1 testimg4 2024-09-17T07:53:12.315 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete...2024-09-17T07:53:12.309+0000 7ff35ec6f700 0 -- 172.21.15.184:0/3160186827 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7ff338001be0 msgr2=0x7ff338004090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:53:12.331 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 100% complete...done. 2024-09-17T07:53:12.335 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2024-09-17T07:53:13.297 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-17T07:53:13.301 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg4 2024-09-17T07:53:13.302 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:13.347 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:13.348 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg5 2024-09-17T07:53:13.348 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:13.397 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:13.398 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg4 2024-09-17T07:53:13.398 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:53:13.398 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:53:13.398 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:53:13.453 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:53:13.453 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg4 2024-09-17T07:53:13.453 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '.*snap1.*' 2024-09-17T07:53:13.507 INFO:tasks.workunit.client.0.smithi184.stdout: 18 snap1 256 MiB Tue Sep 17 07:53:12 2024 2024-09-17T07:53:13.508 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img1.new 2024-09-17T07:53:13.603 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:13.609 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg2 /tmp/img2.new 2024-09-17T07:53:13.742 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:13.746 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg3 /tmp/img3.new 2024-09-17T07:53:13.843 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:13.847 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2024-09-17T07:53:13.940 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:13.944 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2024-09-17T07:53:14.081 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:14.085 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2024-09-17T07:53:14.183 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:14.187 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img2.new 2024-09-17T07:53:14.421 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img3 /tmp/img3.new 2024-09-17T07:53:14.538 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2024-09-17T07:53:14.734 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2024-09-17T07:53:14.837 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rollback --snap=snap1 testimg1 2024-09-17T07:53:14.969 INFO:tasks.workunit.client.0.smithi184.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-17T07:53:14.980 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2024-09-17T07:53:15.117 INFO:tasks.workunit.client.0.smithi184.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-17T07:53:15.125 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:15.125 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg1 2024-09-17T07:53:15.167 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:15.168 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff1 2024-09-17T07:53:15.168 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:15.218 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:15.218 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img1.snap1 2024-09-17T07:53:15.349 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:15.353 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2024-09-17T07:53:15.481 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:15.486 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2024-09-17T07:53:15.675 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2024-09-17T07:53:15.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm testimg2 2024-09-17T07:53:16.025 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete...2024-09-17T07:53:16.021+0000 7f7bd2276700 0 -- 172.21.15.184:0/709595537 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x561b29d46b70 msgr2=0x561b29d21dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:16.063 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-17T07:53:16.061+0000 7f7bd2276700 0 -- 172.21.15.184:0/709595537 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f7bb803a6f0 msgr2=0x7f7bb803cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:53:16.064 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:53:16.068 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm testimg3 2024-09-17T07:53:16.236 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-17T07:53:16.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create testimg2 -s 0 2024-09-17T07:53:16.277 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:16.273+0000 7fdbcf1114c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:16.289 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd cp testimg2 testimg3 2024-09-17T07:53:16.364 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 100% complete...done. 2024-09-17T07:53:16.368 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep cp testimg2 testimg6 2024-09-17T07:53:16.453 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 100% complete...done. 2024-09-17T07:53:16.458 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm --snap=snap1 testimg1 2024-09-17T07:53:17.237 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:53:17.245 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2024-09-17T07:53:18.244 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:53:18.254 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg1 2024-09-17T07:53:18.254 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-17T07:53:18.311 INFO:tasks.workunit.client.0.smithi184.stdout:error setting snapshot context: (2) No such file or directory 2024-09-17T07:53:18.312 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-17T07:53:18.313 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-17T07:53:18.356 INFO:tasks.workunit.client.0.smithi184.stdout:error setting snapshot context: (2) No such file or directory 2024-09-17T07:53:18.356 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd sparsify testimg1 2024-09-17T07:53:18.710 INFO:tasks.workunit.client.0.smithi184.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2024-09-17T07:53:18.717 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:53:18.717 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:18.894 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:19.013 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:19.236 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:20.446 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:21.461 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:21.691 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:21.862 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:22.132 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:22.363 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:22.501 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:22.624 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:22.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:22.880 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:23.012 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:23.140 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:23.268 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:23.530 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:23.655 INFO:tasks.workunit.client.0.smithi184.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-17T07:53:23.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_locking 2024-09-17T07:53:23.761 INFO:tasks.workunit.client.0.smithi184.stdout:testing locking... 2024-09-17T07:53:23.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing locking...' 2024-09-17T07:53:23.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:53:23.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:23.885 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.020 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.148 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.412 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.548 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.678 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.813 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:24.944 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.074 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.205 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.337 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.471 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.601 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.729 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.865 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:25.989 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:26.117 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create -s 1 test1 2024-09-17T07:53:26.157 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:26.153+0000 7fefd04fa4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:26.173 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:53:26.173 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:53:26.174 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:53:26.222 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:53:26.222 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id 2024-09-17T07:53:26.283 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:53:26.284 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 1 ' 2024-09-17T07:53:26.334 INFO:tasks.workunit.client.0.smithi184.stdout:There is 1 exclusive lock on this image. 2024-09-17T07:53:26.336 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd lock list test1 2024-09-17T07:53:26.336 INFO:tasks.workunit.client.0.smithi184.stderr:++ tail -n 1 2024-09-17T07:53:26.336 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1;}' 2024-09-17T07:53:26.383 INFO:tasks.workunit.client.0.smithi184.stderr:+ LOCKER=client.7776 2024-09-17T07:53:26.383 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock remove test1 id client.7776 2024-09-17T07:53:26.619 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:26.617+0000 7f42a5e47700 0 --2- 172.21.15.184:0/4247239178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4288001d50 0x7f42880041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T07:53:27.197 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:53:27.197 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:53:27.197 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:53:27.241 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:53:27.241 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id --shared tag 2024-09-17T07:53:27.305 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:53:27.305 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 1 ' 2024-09-17T07:53:27.356 INFO:tasks.workunit.client.0.smithi184.stdout:There is 1 shared lock on this image. 2024-09-17T07:53:27.356 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id --shared tag 2024-09-17T07:53:27.418 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:53:27.418 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 2 ' 2024-09-17T07:53:27.473 INFO:tasks.workunit.client.0.smithi184.stdout:There are 2 shared locks on this image. 2024-09-17T07:53:27.473 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id2 --shared tag 2024-09-17T07:53:27.542 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:53:27.542 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 3 ' 2024-09-17T07:53:27.590 INFO:tasks.workunit.client.0.smithi184.stdout:There are 3 shared locks on this image. 2024-09-17T07:53:27.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:53:27.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ tail -n 1 2024-09-17T07:53:27.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ awk '{print $2, $1;}' 2024-09-17T07:53:27.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ xargs rbd lock remove test1 2024-09-17T07:53:28.198 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info test1 2024-09-17T07:53:28.198 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -qE 'features:.*exclusive' 2024-09-17T07:53:28.246 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:53:28.311 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:53:28.315 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_thick_provision 2024-09-17T07:53:28.316 INFO:tasks.workunit.client.0.smithi184.stdout:testing thick provision... 2024-09-17T07:53:28.316 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing thick provision...' 2024-09-17T07:53:28.316 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:53:28.316 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:28.450 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:28.584 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:28.714 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:28.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:28.965 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.232 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.362 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.490 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.742 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.871 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:29.999 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:30.130 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:30.259 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:30.382 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:30.516 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:30.652 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --thick-provision -s 64M test1 2024-09-17T07:53:30.695 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:30.693+0000 7f209ab3e4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:30.993 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-17T07:53:31.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ count=0 2024-09-17T07:53:31.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret= 2024-09-17T07:53:31.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 -lt 10 ']' 2024-09-17T07:53:31.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:53:31.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:53:31.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ tr -s ' ' 2024-09-17T07:53:31.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ cut -d ' ' -f 4-5 2024-09-17T07:53:31.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^64 MiB' 2024-09-17T07:53:31.042 INFO:tasks.workunit.client.0.smithi184.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-17T07:53:31.052 INFO:tasks.workunit.client.0.smithi184.stdout:64 MiB 2024-09-17T07:53:31.052 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret=0 2024-09-17T07:53:31.052 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 = 0 ']' 2024-09-17T07:53:31.052 INFO:tasks.workunit.client.0.smithi184.stderr:+ break 2024-09-17T07:53:31.052 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:53:31.091 INFO:tasks.workunit.client.0.smithi184.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-17T07:53:31.096 INFO:tasks.workunit.client.0.smithi184.stdout:NAME PROVISIONED USED 2024-09-17T07:53:31.096 INFO:tasks.workunit.client.0.smithi184.stdout:test1 64 MiB 64 MiB 2024-09-17T07:53:31.100 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 '!=' 0 ']' 2024-09-17T07:53:31.100 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:53:31.201 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2024-09-17T07:53:31.205 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:53:31.205 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:53:31.205 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:53:31.205 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:53:31.239 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:53:31.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --thick-provision -s 4G test1 2024-09-17T07:53:31.275 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:31.273+0000 7fb73b20a4c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:32.310 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete...2024-09-17T07:53:32.305+0000 7fb73953f700 0 -- 172.21.15.184:0/1161644069 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x560a8d6c80a0 msgr2=0x560a8d6ca480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:32.520 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 11% complete... Thick provisioning: 12% complete...2024-09-17T07:53:32.517+0000 7fb73953f700 0 -- 172.21.15.184:0/1161644069 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fb71c03a7f0 msgr2=0x7fb71c03cc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:41.448 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-17T07:53:41.455 INFO:tasks.workunit.client.0.smithi184.stderr:+ count=0 2024-09-17T07:53:41.455 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret= 2024-09-17T07:53:41.455 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 -lt 10 ']' 2024-09-17T07:53:41.455 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:53:41.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:53:41.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ tr -s ' ' 2024-09-17T07:53:41.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ cut -d ' ' -f 4-5 2024-09-17T07:53:41.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^4 GiB' 2024-09-17T07:53:41.497 INFO:tasks.workunit.client.0.smithi184.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-17T07:53:41.516 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:41.513+0000 7f60ad192700 0 -- 172.21.15.184:0/2668319783 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x564a2ed0b8d0 msgr2=0x564a2edb2d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:53:41.535 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:41.533+0000 7f60ac991700 0 -- 172.21.15.184:0/2668319783 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x564a2edb63c0 msgr2=0x564a2edb87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:53:41.717 INFO:tasks.workunit.client.0.smithi184.stdout:4 GiB 2024-09-17T07:53:41.718 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret=0 2024-09-17T07:53:41.718 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 = 0 ']' 2024-09-17T07:53:41.718 INFO:tasks.workunit.client.0.smithi184.stderr:+ break 2024-09-17T07:53:41.718 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:53:41.939 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:41.937+0000 7f4d10397700 0 --2- 172.21.15.184:0/3556534868 >> v2:172.21.15.184:3300/0 conn(0x5641d1f13640 0x5641d1f13a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T07:53:41.962 INFO:tasks.workunit.client.0.smithi184.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-17T07:53:41.982 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:41.981+0000 7f4d10b98700 0 -- 172.21.15.184:0/2128600988 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f4cfc0057f0 msgr2=0x5641d1f22190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:41.986 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:41.985+0000 7f4d10397700 0 -- 172.21.15.184:0/2128600988 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5641d1fcfd10 msgr2=0x5641d1fd20f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:42.126 INFO:tasks.workunit.client.0.smithi184.stdout:NAME PROVISIONED USED 2024-09-17T07:53:42.127 INFO:tasks.workunit.client.0.smithi184.stdout:test1 4 GiB 4 GiB 2024-09-17T07:53:42.129 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 '!=' 0 ']' 2024-09-17T07:53:42.129 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:53:42.268 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete...2024-09-17T07:53:42.265+0000 7ffb60e8a700 0 -- 172.21.15.184:0/3959750718 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x555f3560d380 msgr2=0x555f3560f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:42.288 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 10% complete... Removing image: 11% complete...2024-09-17T07:53:42.285+0000 7ffb6168b700 0 -- 172.21.15.184:0/3959750718 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7ffb4403a7a0 msgr2=0x7ffb4403cbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:53:43.098 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-17T07:53:43.101 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:53:43.101 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:53:43.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:53:43.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:53:43.134 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:53:43.134 INFO:tasks.workunit.client.0.smithi184.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2024-09-17T07:53:43.134 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_others 2024-09-17T07:53:43.134 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing import, export, resize, and snapshots...' 2024-09-17T07:53:43.135 INFO:tasks.workunit.client.0.smithi184.stdout:testing import, export, resize, and snapshots... 2024-09-17T07:53:43.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2024-09-17T07:53:43.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:53:43.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:43.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:43.371 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:43.498 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:43.626 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:43.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:43.875 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.010 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.140 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.271 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.409 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.544 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.673 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.806 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:44.942 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:45.075 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:45.206 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:45.336 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:45.465 INFO:tasks.workunit.client.0.smithi184.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-17T07:53:45.466 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2024-09-17T07:53:45.468 INFO:tasks.workunit.client.0.smithi184.stderr:1+0 records in 2024-09-17T07:53:45.468 INFO:tasks.workunit.client.0.smithi184.stderr:1+0 records out 2024-09-17T07:53:45.468 INFO:tasks.workunit.client.0.smithi184.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000135414 s, 7.6 MB/s 2024-09-17T07:53:45.468 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2024-09-17T07:53:45.469 INFO:tasks.workunit.client.0.smithi184.stderr:10+0 records in 2024-09-17T07:53:45.470 INFO:tasks.workunit.client.0.smithi184.stderr:10+0 records out 2024-09-17T07:53:45.470 INFO:tasks.workunit.client.0.smithi184.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.000230767 s, 44.4 MB/s 2024-09-17T07:53:45.470 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2024-09-17T07:53:45.471 INFO:tasks.workunit.client.0.smithi184.stderr:70+1 records in 2024-09-17T07:53:45.471 INFO:tasks.workunit.client.0.smithi184.stderr:70+1 records out 2024-09-17T07:53:45.471 INFO:tasks.workunit.client.0.smithi184.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000399788 s, 180 MB/s 2024-09-17T07:53:45.472 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2024-09-17T07:53:45.474 INFO:tasks.workunit.client.0.smithi184.stderr:138+1 records in 2024-09-17T07:53:45.474 INFO:tasks.workunit.client.0.smithi184.stderr:138+1 records out 2024-09-17T07:53:45.474 INFO:tasks.workunit.client.0.smithi184.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.00105983 s, 134 MB/s 2024-09-17T07:53:45.475 INFO:tasks.workunit.client.0.smithi184.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2024-09-17T07:53:45.476 INFO:tasks.workunit.client.0.smithi184.stderr:74+1 records in 2024-09-17T07:53:45.476 INFO:tasks.workunit.client.0.smithi184.stderr:74+1 records out 2024-09-17T07:53:45.477 INFO:tasks.workunit.client.0.smithi184.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.000651317 s, 117 MB/s 2024-09-17T07:53:45.477 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2024-09-17T07:53:45.675 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2024-09-17T07:53:45.680 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2024-09-17T07:53:45.749 INFO:tasks.workunit.client.0.smithi184.stderr: Resizing image: 100% complete...done. 2024-09-17T07:53:45.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img2 2024-09-17T07:53:45.906 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:45.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1 --snap=snap1 2024-09-17T07:53:46.711 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:53:46.725 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd resize testimg1 --size=128 2024-09-17T07:53:46.992 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2024-09-17T07:53:47.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:53:47.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2024-09-17T07:53:47.074 INFO:tasks.workunit.client.0.smithi184.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2024-09-17T07:53:47.088 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img3 2024-09-17T07:53:47.198 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:47.204 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg1 2024-09-17T07:53:47.204 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:47.258 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:47.259 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg1 2024-09-17T07:53:47.259 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:47.317 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:47.317 INFO:tasks.workunit.client.0.smithi184.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2024-09-17T07:53:47.319 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2024-09-17T07:53:47.424 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:47.428 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2024-09-17T07:53:47.487 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 100% complete...done. 2024-09-17T07:53:47.491 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2024-09-17T07:53:47.549 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2024-09-17T07:53:47.729 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-09-17T07:53:47.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2024-09-17T07:53:47.815 INFO:tasks.workunit.client.0.smithi184.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2024-09-17T07:53:47.830 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg1 2024-09-17T07:53:47.830 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:47.887 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:47.888 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg1 2024-09-17T07:53:47.888 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:47.949 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:47.950 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff1 2024-09-17T07:53:47.950 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:48.004 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:48.005 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-17T07:53:48.005 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:48.064 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:48.064 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2024-09-17T07:53:48.206 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:48.210 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg1 testimg3 2024-09-17T07:53:48.374 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:48.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2024-09-17T07:53:48.532 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:48.536 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2024-09-17T07:53:48.701 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T07:53:48.706 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg2 2024-09-17T07:53:48.706 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:48.760 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:48.760 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg3 2024-09-17T07:53:48.760 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:48.817 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:48.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff2 2024-09-17T07:53:48.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:48.874 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:48.875 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff3 2024-09-17T07:53:48.875 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:48.931 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:48.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep copy testimg1 testimg4 2024-09-17T07:53:49.795 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-17T07:53:49.799 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2024-09-17T07:53:50.795 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-17T07:53:50.800 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg4 2024-09-17T07:53:50.800 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 128 MiB' 2024-09-17T07:53:50.857 INFO:tasks.workunit.client.0.smithi184.stdout: size 128 MiB in 32 objects 2024-09-17T07:53:50.858 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg5 2024-09-17T07:53:50.858 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:50.910 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:50.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg4 2024-09-17T07:53:50.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:53:50.912 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:53:50.912 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:53:50.962 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:53:50.963 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg4 2024-09-17T07:53:50.963 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '.*snap1.*' 2024-09-17T07:53:51.024 INFO:tasks.workunit.client.0.smithi184.stdout: 26 snap1 256 MiB Tue Sep 17 07:53:49 2024 2024-09-17T07:53:51.024 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img1.new 2024-09-17T07:53:51.136 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:51.141 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg2 /tmp/img2.new 2024-09-17T07:53:51.270 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:51.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg3 /tmp/img3.new 2024-09-17T07:53:51.377 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:51.382 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2024-09-17T07:53:51.489 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:51.493 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2024-09-17T07:53:51.623 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:51.628 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2024-09-17T07:53:51.733 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:51.737 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img2.new 2024-09-17T07:53:51.965 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img3 /tmp/img3.new 2024-09-17T07:53:52.077 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2024-09-17T07:53:52.275 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2024-09-17T07:53:52.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rollback --snap=snap1 testimg1 2024-09-17T07:53:52.528 INFO:tasks.workunit.client.0.smithi184.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-17T07:53:52.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2024-09-17T07:53:52.675 INFO:tasks.workunit.client.0.smithi184.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-17T07:53:52.684 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg1 2024-09-17T07:53:52.684 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:52.736 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:52.737 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg-diff1 2024-09-17T07:53:52.737 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:53:52.794 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:53:52.795 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg1 /tmp/img1.snap1 2024-09-17T07:53:52.940 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:52.944 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2024-09-17T07:53:53.073 INFO:tasks.workunit.client.0.smithi184.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T07:53:53.077 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2024-09-17T07:53:53.268 INFO:tasks.workunit.client.0.smithi184.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2024-09-17T07:53:53.461 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm testimg2 2024-09-17T07:53:53.629 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-17T07:53:53.625+0000 7fac97405700 0 -- 172.21.15.184:0/1893988659 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fac7c008980 msgr2=0x7fac7c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:53.651 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:53:53.655 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm testimg3 2024-09-17T07:53:53.848 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T07:53:53.845+0000 7f7af299c700 0 -- 172.21.15.184:0/3342684407 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f7ad8008980 msgr2=0x7f7ad800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:53:53.869 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:53:53.873 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create testimg2 -s 0 2024-09-17T07:53:53.912 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:53:53.909+0000 7f076b7174c0 -1 librbd: Forced V1 image creation. 2024-09-17T07:53:53.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd cp testimg2 testimg3 2024-09-17T07:53:54.009 INFO:tasks.workunit.client.0.smithi184.stderr: Image copy: 100% complete...done. 2024-09-17T07:53:54.014 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep cp testimg2 testimg6 2024-09-17T07:53:54.109 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 100% complete...done. 2024-09-17T07:53:54.114 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm --snap=snap1 testimg1 2024-09-17T07:53:54.743 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:53:54.759 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2024-09-17T07:53:55.756 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:53:55.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg1 2024-09-17T07:53:55.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-17T07:53:55.817 INFO:tasks.workunit.client.0.smithi184.stdout:error setting snapshot context: (2) No such file or directory 2024-09-17T07:53:55.818 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-17T07:53:55.818 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-17T07:53:55.869 INFO:tasks.workunit.client.0.smithi184.stdout:error setting snapshot context: (2) No such file or directory 2024-09-17T07:53:55.870 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd sparsify testimg1 2024-09-17T07:53:55.964 INFO:tasks.workunit.client.0.smithi184.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2024-09-17T07:53:55.978 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:53:55.978 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:56.243 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:56.371 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:56.585 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:56.984 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:57.985 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:58.191 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:58.464 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.023 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.151 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.276 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.407 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.538 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.809 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:53:59.941 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:00.070 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:00.208 INFO:tasks.workunit.client.0.smithi184.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-17T07:54:00.313 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_locking 2024-09-17T07:54:00.313 INFO:tasks.workunit.client.0.smithi184.stdout:testing locking... 2024-09-17T07:54:00.314 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing locking...' 2024-09-17T07:54:00.314 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:54:00.315 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:00.435 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:00.575 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:00.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:00.841 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:00.968 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:01.104 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:01.651 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:01.784 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:01.920 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:02.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:02.388 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:02.723 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:02.849 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:02.981 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:03.115 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:03.254 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:03.382 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:03.519 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-17T07:54:03.597 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:03.597 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:03.597 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:54:03.646 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:03.646 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id 2024-09-17T07:54:03.713 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:03.714 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 1 ' 2024-09-17T07:54:03.768 INFO:tasks.workunit.client.0.smithi184.stdout:There is 1 exclusive lock on this image. 2024-09-17T07:54:03.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd lock list test1 2024-09-17T07:54:03.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ tail -n 1 2024-09-17T07:54:03.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1;}' 2024-09-17T07:54:03.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ LOCKER=client.8453 2024-09-17T07:54:03.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock remove test1 id client.8453 2024-09-17T07:54:04.200 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:04.201 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:04.201 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:54:04.251 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:04.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id --shared tag 2024-09-17T07:54:04.323 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:04.323 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 1 ' 2024-09-17T07:54:04.379 INFO:tasks.workunit.client.0.smithi184.stdout:There is 1 shared lock on this image. 2024-09-17T07:54:04.380 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id --shared tag 2024-09-17T07:54:04.457 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:04.457 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 2 ' 2024-09-17T07:54:04.513 INFO:tasks.workunit.client.0.smithi184.stdout:There are 2 shared locks on this image. 2024-09-17T07:54:04.514 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock add test1 id2 --shared tag 2024-09-17T07:54:04.587 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:04.587 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep ' 3 ' 2024-09-17T07:54:04.638 INFO:tasks.workunit.client.0.smithi184.stdout:There are 3 shared locks on this image. 2024-09-17T07:54:04.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:04.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ tail -n 1 2024-09-17T07:54:04.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ awk '{print $2, $1;}' 2024-09-17T07:54:04.640 INFO:tasks.workunit.client.0.smithi184.stderr:+ xargs rbd lock remove test1 2024-09-17T07:54:05.205 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info test1 2024-09-17T07:54:05.206 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -qE 'features:.*exclusive' 2024-09-17T07:54:05.265 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd lock list test1 2024-09-17T07:54:05.319 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -n 'There are 2 shared locks on this image. 2024-09-17T07:54:05.320 INFO:tasks.workunit.client.0.smithi184.stderr:Lock tag: tag 2024-09-17T07:54:05.320 INFO:tasks.workunit.client.0.smithi184.stderr:Locker ID Address 2024-09-17T07:54:05.320 INFO:tasks.workunit.client.0.smithi184.stderr:client.8468 id 172.21.15.184:0/4254729392 2024-09-17T07:54:05.320 INFO:tasks.workunit.client.0.smithi184.stderr:client.8474 id 172.21.15.184:0/2308525678' ']' 2024-09-17T07:54:05.321 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:05.321 INFO:tasks.workunit.client.0.smithi184.stderr:+ tail -n 1 2024-09-17T07:54:05.321 INFO:tasks.workunit.client.0.smithi184.stderr:+ awk '{print $2, $1;}' 2024-09-17T07:54:05.321 INFO:tasks.workunit.client.0.smithi184.stderr:+ xargs rbd lock remove test1 2024-09-17T07:54:06.211 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd lock list test1 2024-09-17T07:54:06.270 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -n 'There is 1 shared lock on this image. 2024-09-17T07:54:06.271 INFO:tasks.workunit.client.0.smithi184.stderr:Lock tag: tag 2024-09-17T07:54:06.271 INFO:tasks.workunit.client.0.smithi184.stderr:Locker ID Address 2024-09-17T07:54:06.271 INFO:tasks.workunit.client.0.smithi184.stderr:client.8468 id 172.21.15.184:0/4254729392' ']' 2024-09-17T07:54:06.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd lock list test1 2024-09-17T07:54:06.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ tail -n 1 2024-09-17T07:54:06.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ awk '{print $2, $1;}' 2024-09-17T07:54:06.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ xargs rbd lock remove test1 2024-09-17T07:54:07.218 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd lock list test1 2024-09-17T07:54:07.275 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -n '' ']' 2024-09-17T07:54:07.275 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:54:07.471 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:54:07.468+0000 7f46e7cea700 0 -- 172.21.15.184:0/2404288016 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f46c0005fb0 msgr2=0x7f46c0008440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:54:07.472 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:07.477 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_clone 2024-09-17T07:54:07.477 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing clone...' 2024-09-17T07:54:07.477 INFO:tasks.workunit.client.0.smithi184.stdout:testing clone... 2024-09-17T07:54:07.478 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:54:07.478 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:07.609 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:07.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:07.870 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.006 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.136 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.270 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.403 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.537 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.803 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:08.935 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:09.277 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:09.410 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:09.542 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:09.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:09.798 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:09.930 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:10.071 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create test1 --image-format 2 -s 1 2024-09-17T07:54:10.142 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@s1 2024-09-17T07:54:11.240 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:11.254 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect test1@s1 2024-09-17T07:54:11.319 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool create rbd2 8 2024-09-17T07:54:12.328 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'rbd2' already exists 2024-09-17T07:54:12.336 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd pool init rbd2 2024-09-17T07:54:15.248 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone test1@s1 rbd2/clone 2024-09-17T07:54:15.349 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd -p rbd2 ls 2024-09-17T07:54:15.349 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep clone 2024-09-17T07:54:15.395 INFO:tasks.workunit.client.0.smithi184.stdout:clone 2024-09-17T07:54:15.396 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd -p rbd2 ls -l 2024-09-17T07:54:15.396 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep clone 2024-09-17T07:54:15.396 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1@s1 2024-09-17T07:54:15.472 INFO:tasks.workunit.client.0.smithi184.stdout:clone 1 MiB rbd/test1@s1 2 2024-09-17T07:54:15.473 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:15.473 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v clone 2024-09-17T07:54:15.515 INFO:tasks.workunit.client.0.smithi184.stdout:test1 2024-09-17T07:54:15.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd flatten rbd2/clone 2024-09-17T07:54:15.593 INFO:tasks.workunit.client.0.smithi184.stderr: Image flatten: 100% complete...done. 2024-09-17T07:54:15.606 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create rbd2/clone@s1 2024-09-17T07:54:16.257 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:16.266 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect rbd2/clone@s1 2024-09-17T07:54:16.323 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone rbd2/clone@s1 clone2 2024-09-17T07:54:16.432 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:16.432 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep clone2 2024-09-17T07:54:16.475 INFO:tasks.workunit.client.0.smithi184.stdout:clone2 2024-09-17T07:54:16.476 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:54:16.476 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep clone2 2024-09-17T07:54:16.476 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep rbd2/clone@s1 2024-09-17T07:54:16.762 INFO:tasks.workunit.client.0.smithi184.stdout:clone2 1 MiB rbd2/clone@s1 2 2024-09-17T07:54:16.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd -p rbd2 ls 2024-09-17T07:54:16.763 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v clone2 2024-09-17T07:54:16.805 INFO:tasks.workunit.client.0.smithi184.stdout:clone 2024-09-17T07:54:16.806 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm clone2 2024-09-17T07:54:16.995 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:54:16.992+0000 7f1d1e8a3700 0 -- 172.21.15.184:0/767784861 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f1d04008980 msgr2=0x7f1d0400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:54:16.995 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:17.000 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect rbd2/clone@s1 2024-09-17T07:54:17.068 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm rbd2/clone@s1 2024-09-17T07:54:17.256 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:17.268 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm rbd2/clone 2024-09-17T07:54:17.409 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:54:17.404+0000 7ff34d7f6700 0 -- 172.21.15.184:0/1219148051 >> [v2:172.21.15.184:6808/21059,v1:172.21.15.184:6810/21059] conn(0x564330538070 msgr2=0x56433053a4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:54:17.416 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:17.421 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect test1@s1 2024-09-17T07:54:17.496 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm test1@s1 2024-09-17T07:54:18.268 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:18.284 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:54:18.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:54:18.484+0000 7fb694253700 0 -- 172.21.15.184:0/3102731779 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fb678008980 msgr2=0x7fb67800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:54:18.487 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:18.492 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2024-09-17T07:54:19.371 INFO:tasks.workunit.client.0.smithi184.stderr:pool 'rbd2' does not exist 2024-09-17T07:54:19.383 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_trash 2024-09-17T07:54:19.383 INFO:tasks.workunit.client.0.smithi184.stdout:testing trash... 2024-09-17T07:54:19.384 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing trash...' 2024-09-17T07:54:19.384 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:54:19.384 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:19.513 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:19.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:19.775 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:19.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.049 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.180 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.317 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.450 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.584 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.707 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.836 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:20.971 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:21.106 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:21.245 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:21.369 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:21.506 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:21.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:21.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-17T07:54:21.844 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-17T07:54:21.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:21.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:54:21.944 INFO:tasks.workunit.client.0.smithi184.stdout:test1 2024-09-17T07:54:21.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test2 2024-09-17T07:54:21.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:21.989 INFO:tasks.workunit.client.0.smithi184.stdout:test2 2024-09-17T07:54:21.990 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:21.990 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:21.990 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:54:22.032 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:54:22.033 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:54:22.033 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test1.*2.*' 2024-09-17T07:54:22.092 INFO:tasks.workunit.client.0.smithi184.stdout:test1 1 MiB 2 2024-09-17T07:54:22.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:54:22.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test2.*2.*' 2024-09-17T07:54:22.151 INFO:tasks.workunit.client.0.smithi184.stdout:test2 1 MiB 2 2024-09-17T07:54:22.151 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv test1 2024-09-17T07:54:22.255 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:22.255 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test2 2024-09-17T07:54:22.298 INFO:tasks.workunit.client.0.smithi184.stdout:test2 2024-09-17T07:54:22.298 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:22.299 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:22.299 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:22.341 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:22.342 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:54:22.342 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test2.*2.*' 2024-09-17T07:54:22.397 INFO:tasks.workunit.client.0.smithi184.stdout:test2 1 MiB 2 2024-09-17T07:54:22.398 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:22.398 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:54:22.439 INFO:tasks.workunit.client.0.smithi184.stdout:22658779b4e2 test1 2024-09-17T07:54:22.440 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:22.440 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:22.440 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:22.481 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:22.482 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -l 2024-09-17T07:54:22.482 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test1.*USER.*' 2024-09-17T07:54:22.538 INFO:tasks.workunit.client.0.smithi184.stdout:22658779b4e2 test1 USER Tue Sep 17 07:54:22 2024 expired at Tue Sep 17 07:54:22 2024 2024-09-17T07:54:22.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -l 2024-09-17T07:54:22.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v 'protected until' 2024-09-17T07:54:22.592 INFO:tasks.workunit.client.0.smithi184.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2024-09-17T07:54:22.592 INFO:tasks.workunit.client.0.smithi184.stdout:22658779b4e2 test1 USER Tue Sep 17 07:54:22 2024 expired at Tue Sep 17 07:54:22 2024 2024-09-17T07:54:22.593 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:54:22.594 INFO:tasks.workunit.client.0.smithi184.stderr:++ cut -d ' ' -f 1 2024-09-17T07:54:22.637 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=22658779b4e2 2024-09-17T07:54:22.637 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash rm 22658779b4e2 2024-09-17T07:54:22.743 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:22.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv test2 2024-09-17T07:54:22.852 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:54:22.853 INFO:tasks.workunit.client.0.smithi184.stderr:++ cut -d ' ' -f 1 2024-09-17T07:54:22.895 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=22681cd8c50b 2024-09-17T07:54:22.895 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info --image-id 22681cd8c50b 2024-09-17T07:54:22.895 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'rbd image '\''test2'\''' 2024-09-17T07:54:22.953 INFO:tasks.workunit.client.0.smithi184.stdout:rbd image 'test2': 2024-09-17T07:54:22.954 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd children --image-id 22681cd8c50b 2024-09-17T07:54:22.954 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:22.954 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:23.015 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:23.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash restore 22681cd8c50b 2024-09-17T07:54:23.078 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:23.079 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test2 2024-09-17T07:54:23.325 INFO:tasks.workunit.client.0.smithi184.stdout:test2 2024-09-17T07:54:23.326 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:54:23.326 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:23.326 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:23.373 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:23.374 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls -l 2024-09-17T07:54:23.374 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test2.*2.*' 2024-09-17T07:54:23.428 INFO:tasks.workunit.client.0.smithi184.stdout:test2 1 MiB 2 2024-09-17T07:54:23.429 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2024-09-17T07:54:23.531 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: image test2 will expire at 2024-09-17T08:54:23.471565+0000 2024-09-17T07:54:23.536 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:23.537 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test2 2024-09-17T07:54:23.575 INFO:tasks.workunit.client.0.smithi184.stdout:22681cd8c50b test2 2024-09-17T07:54:23.576 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:23.576 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:23.576 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:23.613 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:23.614 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -l 2024-09-17T07:54:23.614 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test2.*USER.*protected until' 2024-09-17T07:54:23.670 INFO:tasks.workunit.client.0.smithi184.stdout:22681cd8c50b test2 USER Tue Sep 17 07:54:23 2024 protected until Tue Sep 17 08:54:23 2024 2024-09-17T07:54:23.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash rm 22681cd8c50b 2024-09-17T07:54:23.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'Deferment time has not expired' 2024-09-17T07:54:23.714 INFO:tasks.workunit.client.0.smithi184.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2024-09-17T07:54:23.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash rm --image-id 22681cd8c50b --force 2024-09-17T07:54:23.826 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:23.831 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-17T07:54:23.905 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@snap1 2024-09-17T07:54:24.211 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:24.226 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect test1@snap1 2024-09-17T07:54:24.297 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone test1@snap1 clone 2024-09-17T07:54:24.402 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv test1 2024-09-17T07:54:24.505 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:24.505 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:54:24.547 INFO:tasks.workunit.client.0.smithi184.stdout:22c24f62e9e9 test1 2024-09-17T07:54:24.547 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:24.547 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:24.548 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:24.588 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:24.588 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -l 2024-09-17T07:54:24.588 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test1.*USER.*' 2024-09-17T07:54:24.644 INFO:tasks.workunit.client.0.smithi184.stdout:22c24f62e9e9 test1 USER Tue Sep 17 07:54:24 2024 expired at Tue Sep 17 07:54:24 2024 2024-09-17T07:54:24.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -l 2024-09-17T07:54:24.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v 'protected until' 2024-09-17T07:54:24.703 INFO:tasks.workunit.client.0.smithi184.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2024-09-17T07:54:24.703 INFO:tasks.workunit.client.0.smithi184.stdout:22c24f62e9e9 test1 USER Tue Sep 17 07:54:24 2024 expired at Tue Sep 17 07:54:24 2024 2024-09-17T07:54:24.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:54:24.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ cut -d ' ' -f 1 2024-09-17T07:54:24.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=22c24f62e9e9 2024-09-17T07:54:24.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls --image-id 22c24f62e9e9 2024-09-17T07:54:24.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:54:24.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:24.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:24.807 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:24.808 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls --image-id 22c24f62e9e9 2024-09-17T07:54:24.808 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '.*snap1.*' 2024-09-17T07:54:24.872 INFO:tasks.workunit.client.0.smithi184.stdout: 34 snap1 1 MiB yes Tue Sep 17 07:54:24 2024 2024-09-17T07:54:24.873 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:24.873 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:24.873 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd children --image-id 22c24f62e9e9 2024-09-17T07:54:24.942 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:24.943 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd children --image-id 22c24f62e9e9 2024-09-17T07:54:24.943 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep clone 2024-09-17T07:54:25.011 INFO:tasks.workunit.client.0.smithi184.stdout:rbd/clone 2024-09-17T07:54:25.011 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm clone 2024-09-17T07:54:25.184 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:54:25.180+0000 7f1491795700 0 -- 172.21.15.184:0/289962797 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f147403a830 msgr2=0x7f147403cc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:54:25.213 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:25.218 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect --image-id 22c24f62e9e9 --snap snap1 2024-09-17T07:54:25.296 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm --image-id 22c24f62e9e9 --snap snap1 2024-09-17T07:54:26.203 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:26.223 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls --image-id 22c24f62e9e9 2024-09-17T07:54:26.223 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:26.223 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:54:26.224 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:26.277 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:26.278 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash restore 22c24f62e9e9 2024-09-17T07:54:26.340 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@snap1 2024-09-17T07:54:27.222 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:27.238 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@snap2 2024-09-17T07:54:28.223 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:28.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls --image-id 22c24f62e9e9 2024-09-17T07:54:28.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:54:28.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:28.239 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:54:28.293 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:54:28.293 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge --image-id 22c24f62e9e9 2024-09-17T07:54:30.226 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:54:30.244 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls --image-id 22c24f62e9e9 2024-09-17T07:54:30.244 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:54:30.244 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:30.244 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:30.296 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:30.297 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2024-09-17T07:54:30.398 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:30.404 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:30.404 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:54:30.442 INFO:tasks.workunit.client.0.smithi184.stdout:22c24f62e9e9 test1 2024-09-17T07:54:30.443 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:30.443 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:30.443 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:30.485 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:30.486 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -l 2024-09-17T07:54:30.486 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'test1.*USER.*protected until' 2024-09-17T07:54:30.547 INFO:tasks.workunit.client.0.smithi184.stdout:22c24f62e9e9 test1 USER Tue Sep 17 07:54:30 2024 protected until Tue Sep 17 08:54:30 2024 2024-09-17T07:54:30.547 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash rm 22c24f62e9e9 2024-09-17T07:54:30.548 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'Deferment time has not expired' 2024-09-17T07:54:30.591 INFO:tasks.workunit.client.0.smithi184.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2024-09-17T07:54:30.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash rm --image-id 22c24f62e9e9 --force 2024-09-17T07:54:30.695 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:54:30.700 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:54:30.700 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:30.833 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:30.967 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:31.104 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:31.236 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:31.371 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:31.501 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:31.634 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:31.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:31.895 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.028 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.161 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.300 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.433 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.563 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.700 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.829 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:32.954 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:33.091 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_purge 2024-09-17T07:54:33.092 INFO:tasks.workunit.client.0.smithi184.stdout:testing trash purge... 2024-09-17T07:54:33.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing trash purge...' 2024-09-17T07:54:33.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:54:33.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:33.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:33.378 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:33.512 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:33.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:33.779 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:33.916 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.048 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.187 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.319 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.588 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.728 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.863 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:34.996 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:35.136 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:35.270 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:35.404 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:54:35.536 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:35.537 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:35.537 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:35.574 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:35.575 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:35.614 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete...done. 2024-09-17T07:54:35.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:54:35.689 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-17T07:54:35.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg1 2024-09-17T07:54:35.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg2 2024-09-17T07:54:35.973 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:35.973 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:35.973 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:54:36.012 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:54:36.012 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:36.176 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 50% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:54:36.181 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:36.182 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:36.182 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:36.222 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:36.223 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:54:36.300 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-17T07:54:36.366 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2024-09-17T07:54:36.458 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: image testimg1 will expire at 2024-09-17T08:54:36.403868+0000 2024-09-17T07:54:36.463 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2024-09-17T07:54:36.566 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: image testimg2 will expire at 2024-09-17T10:54:36.506403+0000 2024-09-17T07:54:36.571 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:36.572 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:36.572 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:54:36.614 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:54:36.615 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:36.650 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete...done. 2024-09-17T07:54:36.653 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:36.654 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:54:36.654 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:36.695 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:54:36.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2024-09-17T07:54:36.815 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:54:36.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:36.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:36.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:36.866 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:36.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:36.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:54:36.907 INFO:tasks.workunit.client.0.smithi184.stdout:2411b13b2d32 testimg2 2024-09-17T07:54:36.908 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2024-09-17T07:54:37.019 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:54:37.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:37.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:37.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:37.069 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:37.069 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:54:37.136 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1@snap 2024-09-17T07:54:38.208 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:38.223 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-17T07:54:38.294 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-17T07:54:38.357 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg1 2024-09-17T07:54:38.453 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg2 2024-09-17T07:54:38.559 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg3 2024-09-17T07:54:38.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:38.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:38.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:54:38.708 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:54:38.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:38.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:54:38.963 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:54:38.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:38.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:38.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:39.006 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:39.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:39.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg1 2024-09-17T07:54:39.050 INFO:tasks.workunit.client.0.smithi184.stdout:2432f06d61a testimg1 2024-09-17T07:54:39.051 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:54:39.051 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{ print $1 }' 2024-09-17T07:54:39.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=2432f06d61a 2024-09-17T07:54:39.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge --image-id 2432f06d61a 2024-09-17T07:54:39.209 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:54:39.229 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:39.337 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:54:39.342 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:39.342 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:39.342 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:39.382 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:39.383 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:54:39.456 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-17T07:54:39.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg2@snap 2024-09-17T07:54:40.223 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:40.238 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-17T07:54:40.317 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg1 2024-09-17T07:54:40.415 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg2 2024-09-17T07:54:40.519 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg3 2024-09-17T07:54:40.629 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:40.630 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:40.630 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:54:40.670 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:54:40.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:40.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:54:40.944 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:54:40.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:40.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:40.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:40.984 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:40.984 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:40.985 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:54:41.025 INFO:tasks.workunit.client.0.smithi184.stdout:2462c5f535c4 testimg2 2024-09-17T07:54:41.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:54:41.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{ print $1 }' 2024-09-17T07:54:41.068 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=2462c5f535c4 2024-09-17T07:54:41.069 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge --image-id 2462c5f535c4 2024-09-17T07:54:41.226 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:54:41.241 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:41.349 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:54:41.354 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:41.355 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:41.355 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:41.395 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:41.396 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:54:41.464 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-17T07:54:41.531 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-17T07:54:41.596 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg3@snap 2024-09-17T07:54:42.236 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:42.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg1 2024-09-17T07:54:42.358 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg2 2024-09-17T07:54:42.454 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg3 2024-09-17T07:54:42.556 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:42.557 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:42.557 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:54:42.599 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:54:42.600 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:42.600 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:54:42.862 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:54:42.863 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:42.863 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:42.863 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:54:42.903 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:54:42.904 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:42.904 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg3 2024-09-17T07:54:42.945 INFO:tasks.workunit.client.0.smithi184.stdout:24922bbf38e4 testimg3 2024-09-17T07:54:42.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:54:42.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{ print $1 }' 2024-09-17T07:54:42.987 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=24922bbf38e4 2024-09-17T07:54:42.987 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge --image-id 24922bbf38e4 2024-09-17T07:54:43.243 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:54:43.260 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:43.363 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:54:43.368 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:43.368 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:43.368 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:43.409 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:43.409 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:54:43.478 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1@snap 2024-09-17T07:54:44.254 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:44.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-17T07:54:44.377 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg1@snap 2024-09-17T07:54:44.454 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:44.472 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-17T07:54:44.546 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg2@snap 2024-09-17T07:54:45.273 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:45.291 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-17T07:54:45.433 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-17T07:54:45.570 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg2@snap 2024-09-17T07:54:45.660 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:45.676 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg4@snap 2024-09-17T07:54:46.269 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:46.289 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-17T07:54:46.438 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg4@snap 2024-09-17T07:54:46.544 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:46.561 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg1 2024-09-17T07:54:46.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg2 2024-09-17T07:54:46.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg3 2024-09-17T07:54:46.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg4 2024-09-17T07:54:47.196 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:47.196 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:47.196 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:54:47.236 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:54:47.236 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:47.237 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:54:47.644 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:54:47.644 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:47.644 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:47.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:54:47.686 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:54:47.686 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:47.687 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg1 2024-09-17T07:54:47.726 INFO:tasks.workunit.client.0.smithi184.stdout:24b96ffa83e3 testimg1 2024-09-17T07:54:47.727 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:47.727 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:54:47.768 INFO:tasks.workunit.client.0.smithi184.stdout:24bfcc5714c1 testimg2 2024-09-17T07:54:47.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:47.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg4 2024-09-17T07:54:47.809 INFO:tasks.workunit.client.0.smithi184.stdout:24cb7ae96229 testimg4 2024-09-17T07:54:47.809 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg6 2024-09-17T07:54:47.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:47.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:47.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:54:47.949 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:54:47.950 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:47.950 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:54:49.524 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:54:49.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:49.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:49.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:54:49.566 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:54:49.567 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:49.567 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg1 2024-09-17T07:54:49.610 INFO:tasks.workunit.client.0.smithi184.stdout:24b96ffa83e3 testimg1 2024-09-17T07:54:49.611 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:49.611 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:54:49.651 INFO:tasks.workunit.client.0.smithi184.stdout:24bfcc5714c1 testimg2 2024-09-17T07:54:49.652 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg5 2024-09-17T07:54:49.758 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:49.758 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:49.758 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:54:49.801 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:54:49.801 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:49.963 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:54:49.960+0000 7f7d6aa3a700 0 -- 172.21.15.184:0/534741278 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f7d44054c80 msgr2=0x7f7d44057060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:54:49.993 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:54:49.992+0000 7f7d6b23b700 0 -- 172.21.15.184:0/534741278 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f7d4c03aac0 msgr2=0x7f7d4c03cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:54:51.398 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:54:51.403 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:51.403 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:51.403 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:54:51.440 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:54:51.440 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:54:51.511 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1@snap 2024-09-17T07:54:52.289 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:52.306 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-17T07:54:52.427 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg1@snap 2024-09-17T07:54:52.500 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:52.516 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-17T07:54:52.586 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg3@snap 2024-09-17T07:54:53.296 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:53.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg2@snap 2024-09-17T07:54:54.305 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:54.321 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-17T07:54:54.452 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-17T07:54:54.575 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg2@snap 2024-09-17T07:54:54.662 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:54.679 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg4@snap 2024-09-17T07:54:55.314 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:54:55.333 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-17T07:54:55.464 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg4@snap 2024-09-17T07:54:55.567 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:54:55.588 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg1 2024-09-17T07:54:55.686 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg2 2024-09-17T07:54:55.797 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg3 2024-09-17T07:54:55.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg4 2024-09-17T07:54:56.004 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:56.004 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:54:56.004 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:56.044 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:54:56.045 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:56.045 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:54:56.286 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:54:56.287 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:56.287 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:54:56.287 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:56.329 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:54:56.329 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg6 2024-09-17T07:54:56.441 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:56.441 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:56.442 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 5 2024-09-17T07:54:56.479 INFO:tasks.workunit.client.0.smithi184.stdout:5 2024-09-17T07:54:56.480 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:56.481 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:54:57.766 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:54:57.767 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:57.767 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:57.768 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:54:57.805 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:54:57.806 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:57.806 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg1 2024-09-17T07:54:57.842 INFO:tasks.workunit.client.0.smithi184.stdout:2519357cb8b testimg1 2024-09-17T07:54:57.842 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:57.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:54:57.882 INFO:tasks.workunit.client.0.smithi184.stdout:251f36bf6497 testimg2 2024-09-17T07:54:57.883 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:57.883 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg3 2024-09-17T07:54:57.920 INFO:tasks.workunit.client.0.smithi184.stdout:2525de7a4708 testimg3 2024-09-17T07:54:57.920 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg5 2024-09-17T07:54:58.024 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:54:58.024 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:54:58.024 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:54:58.064 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:54:58.065 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:54:58.065 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:55:00.573 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:55:00.574 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:00.574 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:00.574 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:55:00.613 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:55:00.614 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:00.614 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg3 2024-09-17T07:55:00.654 INFO:tasks.workunit.client.0.smithi184.stdout:2525de7a4708 testimg3 2024-09-17T07:55:00.655 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:55:00.655 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{ print $1 }' 2024-09-17T07:55:00.697 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=2525de7a4708 2024-09-17T07:55:00.698 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge --image-id 2525de7a4708 2024-09-17T07:55:01.332 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:55:01.347 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:01.453 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:55:01.459 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:01.459 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:01.459 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:55:01.500 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:55:01.501 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:55:01.573 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1@snap 2024-09-17T07:55:02.337 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:02.352 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-17T07:55:02.469 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg1@snap 2024-09-17T07:55:02.537 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:02.552 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-17T07:55:02.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg2@snap 2024-09-17T07:55:03.218 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:03.236 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-17T07:55:03.367 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-17T07:55:03.496 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg2@snap 2024-09-17T07:55:03.585 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:03.601 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg4@snap 2024-09-17T07:55:04.364 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:04.380 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-17T07:55:04.541 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg4@snap 2024-09-17T07:55:04.635 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:04.654 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2024-09-17T07:55:04.795 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:04.799 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2024-09-17T07:55:04.948 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:04.952 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg3 2024-09-17T07:55:05.059 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2024-09-17T07:55:05.204 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:05.210 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:05.210 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:05.211 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:55:05.251 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:55:05.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:05.252 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:55:05.669 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:55:05.669 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:05.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:05.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:55:05.708 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:55:05.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:05.709 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg1 2024-09-17T07:55:05.746 INFO:tasks.workunit.client.0.smithi184.stdout:2585330ebf2e testimg1 2024-09-17T07:55:05.746 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:55:05.747 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:05.785 INFO:tasks.workunit.client.0.smithi184.stdout:258b246dda28 testimg2 2024-09-17T07:55:05.786 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:05.786 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg4 2024-09-17T07:55:05.826 INFO:tasks.workunit.client.0.smithi184.stdout:2597888c6e31 testimg4 2024-09-17T07:55:05.826 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg6 2024-09-17T07:55:05.932 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:05.932 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:05.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:55:05.972 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:55:05.972 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:05.973 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:55:06.536 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:55:06.537 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:06.537 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:06.537 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 2 2024-09-17T07:55:06.577 INFO:tasks.workunit.client.0.smithi184.stdout:2 2024-09-17T07:55:06.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:06.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg1 2024-09-17T07:55:06.621 INFO:tasks.workunit.client.0.smithi184.stdout:2585330ebf2e testimg1 2024-09-17T07:55:06.621 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:06.622 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:55:06.662 INFO:tasks.workunit.client.0.smithi184.stdout:258b246dda28 testimg2 2024-09-17T07:55:06.662 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg5 2024-09-17T07:55:06.773 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:06.773 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:06.773 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:55:06.814 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:55:06.815 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:06.986 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:06.984+0000 7fe014db3700 0 -- 172.21.15.184:0/3098192757 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x5556462f4d70 msgr2=0x5556462f7150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:07.007 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:07.004+0000 7fe014db3700 0 -- 172.21.15.184:0/3098192757 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fdff403aae0 msgr2=0x7fdff403cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:08.336 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:55:08.340 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:08.340 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:08.340 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:55:08.376 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:55:08.377 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-17T07:55:08.450 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1@snap 2024-09-17T07:55:09.371 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:09.387 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-17T07:55:09.502 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg1@snap 2024-09-17T07:55:09.579 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:09.595 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-17T07:55:09.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg3@snap 2024-09-17T07:55:10.373 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:10.389 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg2@snap 2024-09-17T07:55:11.382 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:11.398 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-17T07:55:11.529 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-17T07:55:11.667 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg2@snap 2024-09-17T07:55:11.756 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:11.774 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg4@snap 2024-09-17T07:55:12.385 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:12.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-17T07:55:12.551 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm testimg4@snap 2024-09-17T07:55:12.648 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:12.665 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2024-09-17T07:55:12.810 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:12.815 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2024-09-17T07:55:12.959 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:12.963 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg3 2024-09-17T07:55:13.071 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2024-09-17T07:55:13.224 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:13.228 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:13.228 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:13.229 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:55:13.266 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:55:13.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:13.267 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:55:13.508 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:55:13.509 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:13.510 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:55:13.510 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:13.551 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:55:13.551 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg6 2024-09-17T07:55:13.665 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:13.665 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:13.665 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 5 2024-09-17T07:55:13.706 INFO:tasks.workunit.client.0.smithi184.stdout:5 2024-09-17T07:55:13.707 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:13.707 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:55:14.629 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:55:14.629 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:14.629 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:14.629 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 3 2024-09-17T07:55:14.669 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:55:14.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:14.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg1 2024-09-17T07:55:14.712 INFO:tasks.workunit.client.0.smithi184.stdout:25e5fb37e835 testimg1 2024-09-17T07:55:14.712 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:14.712 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg2 2024-09-17T07:55:14.756 INFO:tasks.workunit.client.0.smithi184.stdout:25eba049a9f8 testimg2 2024-09-17T07:55:14.757 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:14.757 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg3 2024-09-17T07:55:14.798 INFO:tasks.workunit.client.0.smithi184.stdout:25f1f6565402 testimg3 2024-09-17T07:55:14.798 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash mv testimg5 2024-09-17T07:55:14.907 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:14.907 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:14.907 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 4 2024-09-17T07:55:14.946 INFO:tasks.workunit.client.0.smithi184.stdout:4 2024-09-17T07:55:14.947 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:14.947 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'some expired images could not be removed' 2024-09-17T07:55:16.577 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: some expired images could not be removed 2024-09-17T07:55:16.577 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:16.577 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:16.577 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:55:16.619 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:55:16.620 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:16.620 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep testimg3 2024-09-17T07:55:16.659 INFO:tasks.workunit.client.0.smithi184.stdout:25f1f6565402 testimg3 2024-09-17T07:55:16.660 INFO:tasks.workunit.client.0.smithi184.stderr:++ rbd trash ls 2024-09-17T07:55:16.660 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{ print $1 }' 2024-09-17T07:55:16.703 INFO:tasks.workunit.client.0.smithi184.stderr:+ ID=25f1f6565402 2024-09-17T07:55:16.703 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge --image-id 25f1f6565402 2024-09-17T07:55:17.402 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:55:17.417 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash purge 2024-09-17T07:55:17.533 INFO:tasks.workunit.client.0.smithi184.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-17T07:55:17.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls 2024-09-17T07:55:17.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:17.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 0 2024-09-17T07:55:17.578 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:55:17.579 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_deep_copy_clone 2024-09-17T07:55:17.579 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing deep copy clone...' 2024-09-17T07:55:17.579 INFO:tasks.workunit.client.0.smithi184.stdout:testing deep copy clone... 2024-09-17T07:55:17.579 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:55:17.579 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:17.705 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:17.848 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:17.974 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:18.115 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:18.253 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:18.596 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:18.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:19.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:19.222 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:19.359 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:19.497 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:19.630 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:19.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:19.908 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:20.048 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:20.185 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:20.324 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:20.458 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create testimg1 --image-format 2 --size 256 2024-09-17T07:55:20.535 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg1 --snap=snap1 2024-09-17T07:55:20.683 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:20.702 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect testimg1@snap1 2024-09-17T07:55:20.776 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone testimg1@snap1 testimg2 2024-09-17T07:55:20.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg2@snap2 2024-09-17T07:55:21.689 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:21.707 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep copy testimg2 testimg3 2024-09-17T07:55:21.877 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:21.872+0000 7f32501cb700 0 -- 172.21.15.184:0/8542588 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55d45e929f10 msgr2=0x55d45ea1bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:55:22.706 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete...2024-09-17T07:55:22.704+0000 7f32501cb700 0 -- 172.21.15.184:0/8542588 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f323003a9c0 msgr2=0x7f323003cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:22.713 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 100% complete...done. 2024-09-17T07:55:22.719 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg3 2024-09-17T07:55:22.720 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:55:22.791 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:55:22.792 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg3 2024-09-17T07:55:22.792 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'parent: rbd/testimg1@snap1' 2024-09-17T07:55:22.866 INFO:tasks.workunit.client.0.smithi184.stdout: parent: rbd/testimg1@snap1 2024-09-17T07:55:22.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg3 2024-09-17T07:55:22.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:55:22.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:22.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:55:22.939 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:55:22.940 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg3 2024-09-17T07:55:22.940 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '.*snap2.*' 2024-09-17T07:55:23.009 INFO:tasks.workunit.client.0.smithi184.stdout: 76 snap2 256 MiB Tue Sep 17 07:55:22 2024 2024-09-17T07:55:23.010 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg2 2024-09-17T07:55:23.010 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'features:.*deep-flatten' 2024-09-17T07:55:23.080 INFO:tasks.workunit.client.0.smithi184.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-17T07:55:23.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg3 2024-09-17T07:55:23.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'features:.*deep-flatten' 2024-09-17T07:55:23.157 INFO:tasks.workunit.client.0.smithi184.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-17T07:55:23.158 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd flatten testimg2 2024-09-17T07:55:23.261 INFO:tasks.workunit.client.0.smithi184.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2024-09-17T07:55:23.280 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd flatten testimg3 2024-09-17T07:55:23.366 INFO:tasks.workunit.client.0.smithi184.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2024-09-17T07:55:23.382 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect testimg1@snap1 2024-09-17T07:55:23.453 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge testimg2 2024-09-17T07:55:24.210 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:55:24.228 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap purge testimg3 2024-09-17T07:55:25.220 INFO:tasks.workunit.client.0.smithi184.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T07:55:25.234 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm testimg2 2024-09-17T07:55:25.450 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-17T07:55:25.447+0000 7f168ab17700 0 -- 172.21.15.184:0/3645659086 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f166c0060e0 msgr2=0x7f166c008590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:25.451 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:25.455 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm testimg3 2024-09-17T07:55:25.657 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-17T07:55:25.651+0000 7fdfcbae1700 0 -- 172.21.15.184:0/956246135 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55fd15907a40 msgr2=0x55fd158be860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:25.658 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:25.664 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect testimg1@snap1 2024-09-17T07:55:25.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone testimg1@snap1 testimg2 2024-09-17T07:55:25.966 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:25.963+0000 7f71d37cf700 0 --2- 172.21.15.184:0/4172325422 >> v2:172.21.15.184:3300/0 conn(0x562cc2dfd930 0x562cc2dfce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T07:55:26.062 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create testimg2@snap2 2024-09-17T07:55:26.228 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:26.246 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd deep copy --flatten testimg2 testimg3 2024-09-17T07:55:27.332 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:27.327+0000 7fdf98e5c700 0 -- 172.21.15.184:0/1242124168 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fdf7803b2f0 msgr2=0x7fdf7803d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:27.442 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete...2024-09-17T07:55:27.439+0000 7fdf9965d700 0 -- 172.21.15.184:0/1242124168 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55670dc80300 msgr2=0x55670dc826e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:28.059 INFO:tasks.workunit.client.0.smithi184.stderr: Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-17T07:55:28.065 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg3 2024-09-17T07:55:28.065 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'size 256 MiB' 2024-09-17T07:55:28.123 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:55:28.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg3 2024-09-17T07:55:28.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v parent: 2024-09-17T07:55:28.186 INFO:tasks.workunit.client.0.smithi184.stdout:rbd image 'testimg3': 2024-09-17T07:55:28.186 INFO:tasks.workunit.client.0.smithi184.stdout: size 256 MiB in 64 objects 2024-09-17T07:55:28.186 INFO:tasks.workunit.client.0.smithi184.stdout: order 22 (4 MiB objects) 2024-09-17T07:55:28.186 INFO:tasks.workunit.client.0.smithi184.stdout: snapshot_count: 1 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: id: 26febf548ed3 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: block_name_prefix: rbd_data.26febf548ed3 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: format: 2 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: op_features: 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: flags: 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: create_timestamp: Tue Sep 17 07:55:26 2024 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: access_timestamp: Tue Sep 17 07:55:26 2024 2024-09-17T07:55:28.187 INFO:tasks.workunit.client.0.smithi184.stdout: modify_timestamp: Tue Sep 17 07:55:26 2024 2024-09-17T07:55:28.188 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg3 2024-09-17T07:55:28.188 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -v SNAPID 2024-09-17T07:55:28.188 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:28.188 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 1 2024-09-17T07:55:28.248 INFO:tasks.workunit.client.0.smithi184.stdout:1 2024-09-17T07:55:28.249 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap ls testimg3 2024-09-17T07:55:28.249 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '.*snap2.*' 2024-09-17T07:55:28.309 INFO:tasks.workunit.client.0.smithi184.stdout: 80 snap2 256 MiB Tue Sep 17 07:55:27 2024 2024-09-17T07:55:28.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd info testimg2 2024-09-17T07:55:28.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'features:.*deep-flatten' 2024-09-17T07:55:28.384 INFO:tasks.workunit.client.0.smithi184.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-17T07:55:28.385 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd flatten testimg2 2024-09-17T07:55:28.476 INFO:tasks.workunit.client.0.smithi184.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2024-09-17T07:55:28.496 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect testimg1@snap1 2024-09-17T07:55:28.573 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:55:28.573 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:29.464 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:30.472 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:31.599 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:31.729 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:31.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.150 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.289 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.428 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.570 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.858 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:32.992 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:33.126 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:33.259 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:33.397 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:33.536 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:33.685 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_clone_v2 2024-09-17T07:55:33.686 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing clone v2...' 2024-09-17T07:55:33.686 INFO:tasks.workunit.client.0.smithi184.stdout:testing clone v2... 2024-09-17T07:55:33.686 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:55:33.687 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:33.828 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:33.966 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:34.103 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:34.238 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:34.372 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:34.513 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:34.644 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:34.788 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:34.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:35.065 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:35.203 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:35.343 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:35.481 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:35.615 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:35.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:35.891 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:36.031 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:36.170 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-17T07:55:36.250 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@1 2024-09-17T07:55:37.233 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:37.247 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2024-09-17T07:55:37.304 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:37.299+0000 7f6de3fff700 -1 librbd::image::CloneRequest: 0x55ab40ea1740 validate_parent: parent snapshot must be protected 2024-09-17T07:55:37.305 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: clone error: (22) Invalid argument 2024-09-17T07:55:37.309 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-09-17T07:55:37.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2024-09-17T07:55:37.420 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2024-09-17T07:55:37.544 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap protect test1@1 2024-09-17T07:55:37.607 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2024-09-17T07:55:37.745 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd children test1@1 2024-09-17T07:55:37.745 INFO:tasks.workunit.client.0.smithi184.stderr:+ sort 2024-09-17T07:55:37.746 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -E 'test2.*test3.*test4' 2024-09-17T07:55:37.746 INFO:tasks.workunit.client.0.smithi184.stderr:+ tr '\n' ' ' 2024-09-17T07:55:37.818 INFO:tasks.workunit.client.0.smithi184.stdout:rbd/test2 rbd/test3 rbd/test4 2024-09-17T07:55:37.819 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd children --descendants test1 2024-09-17T07:55:37.819 INFO:tasks.workunit.client.0.smithi184.stderr:+ sort 2024-09-17T07:55:37.820 INFO:tasks.workunit.client.0.smithi184.stderr:+ tr '\n' ' ' 2024-09-17T07:55:37.820 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -E 'test2.*test3.*test4' 2024-09-17T07:55:37.920 INFO:tasks.workunit.client.0.smithi184.stdout:rbd/test2 rbd/test3 rbd/test4 2024-09-17T07:55:37.921 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd remove test4 2024-09-17T07:55:38.125 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:38.119+0000 7fbaa0f5d700 0 -- 172.21.15.184:0/972550131 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55b7f3009630 msgr2=0x55b7f300ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:38.129 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:38.134 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap unprotect test1@1 2024-09-17T07:55:38.223 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap remove test1@1 2024-09-17T07:55:38.290 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:38.309 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap list --all test1 2024-09-17T07:55:38.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep -E 'trash \(1\) *$' 2024-09-17T07:55:38.369 INFO:tasks.workunit.client.0.smithi184.stdout: 84 c62e8513-f8c6-4e36-a76b-36e56ad27b42 1 MiB Tue Sep 17 07:55:37 2024 trash (1) 2024-09-17T07:55:38.369 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@2 2024-09-17T07:55:39.239 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:39.257 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:55:39.257 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'image has snapshots' 2024-09-17T07:55:39.357 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2024-09-17T07:55:39.357 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm test1@2 2024-09-17T07:55:40.225 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:40.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:55:40.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'linked clones' 2024-09-17T07:55:40.343 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2024-09-17T07:55:40.344 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test3 2024-09-17T07:55:40.538 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:40.535+0000 7f5d0df19700 0 -- 172.21.15.184:0/2050039272 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55f809734f30 msgr2=0x55f8097dd580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:40.560 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:40.565 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:55:40.565 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep 'linked clones' 2024-09-17T07:55:40.664 INFO:tasks.workunit.client.0.smithi184.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2024-09-17T07:55:40.664 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd flatten test2 2024-09-17T07:55:41.259 INFO:tasks.workunit.client.0.smithi184.stderr: Image flatten: 100% complete...done. 2024-09-17T07:55:41.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap list --all test1 2024-09-17T07:55:41.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:41.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:55:41.327 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:55:41.327 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:55:41.533 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:41.531+0000 7fddceebe700 0 -- 172.21.15.184:0/1852760348 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fddb4008980 msgr2=0x7fddb400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:41.533 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:41.539 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:55:41.757 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:41.751+0000 7ffa65289700 0 -- 172.21.15.184:0/3911360951 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7ffa40008980 msgr2=0x7ffa4000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:41.758 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:41.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-17T07:55:41.836 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@1 2024-09-17T07:55:42.249 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:42.268 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap create test1@2 2024-09-17T07:55:43.270 INFO:tasks.workunit.client.0.smithi184.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T07:55:43.288 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2024-09-17T07:55:43.408 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2024-09-17T07:55:43.532 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm test1@1 2024-09-17T07:55:43.604 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:43.626 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd snap rm test1@2 2024-09-17T07:55:43.706 INFO:tasks.workunit.client.0.smithi184.stderr: Removing snap: 100% complete...done. 2024-09-17T07:55:43.725 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd rm test1 2024-09-17T07:55:43.725 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:55:43.818 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:43.811+0000 7f4f243fe4c0 -1 librbd::api::Image: remove: image has snapshots - not removing 2024-09-17T07:55:43.818 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 0% complete...failed. 2024-09-17T07:55:43.831 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2024-09-17T07:55:43.837 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:55:43.837 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2024-09-17T07:55:43.989 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:43.993 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -a 2024-09-17T07:55:43.994 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:55:44.034 INFO:tasks.workunit.client.0.smithi184.stdout:283255c83918 test1 2024-09-17T07:55:44.035 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test2 2024-09-17T07:55:44.220 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:44.215+0000 7f51e0e67700 0 -- 172.21.15.184:0/274378734 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x5624ea368280 msgr2=0x5624ea37f640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:44.245 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:44.239+0000 7f51e0e67700 0 -- 172.21.15.184:0/274378734 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x5624ea368280 msgr2=0x7f51c003fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:45.306 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:45.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -a 2024-09-17T07:55:45.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:55:45.347 INFO:tasks.workunit.client.0.smithi184.stdout:283255c83918 test1 2024-09-17T07:55:45.347 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test3 2024-09-17T07:55:45.753 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:45.747+0000 7fdfc64fc700 0 -- 172.21.15.184:0/1363944159 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x5642088c4650 msgr2=0x5642088dbb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:55:45.779 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:55:45.775+0000 7fdfc64fc700 0 -- 172.21.15.184:0/1363944159 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fdfa803abb0 msgr2=0x7fdfa803cfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:46.349 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:46.353 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd trash ls -a 2024-09-17T07:55:46.354 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail grep test1 2024-09-17T07:55:46.354 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:55:46.399 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:55:46.399 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_thick_provision 2024-09-17T07:55:46.400 INFO:tasks.workunit.client.0.smithi184.stdout:testing thick provision... 2024-09-17T07:55:46.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing thick provision...' 2024-09-17T07:55:46.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:55:46.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:46.536 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:46.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:46.805 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:46.948 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:47.083 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:47.223 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:47.356 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:47.706 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:47.848 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:47.989 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:48.130 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:48.265 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:48.406 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:48.544 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:49.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:49.240 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:49.381 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:55:49.526 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2024-09-17T07:55:49.914 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-17T07:55:49.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ count=0 2024-09-17T07:55:49.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret= 2024-09-17T07:55:49.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 -lt 10 ']' 2024-09-17T07:55:49.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:55:49.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ tr -s ' ' 2024-09-17T07:55:49.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:55:49.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ cut -d ' ' -f 4-5 2024-09-17T07:55:49.934 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^64 MiB' 2024-09-17T07:55:49.986 INFO:tasks.workunit.client.0.smithi184.stdout:64 MiB 2024-09-17T07:55:49.987 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret=0 2024-09-17T07:55:49.987 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 = 0 ']' 2024-09-17T07:55:49.988 INFO:tasks.workunit.client.0.smithi184.stderr:+ break 2024-09-17T07:55:49.988 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:55:50.036 INFO:tasks.workunit.client.0.smithi184.stdout:NAME PROVISIONED USED 2024-09-17T07:55:50.037 INFO:tasks.workunit.client.0.smithi184.stdout:test1 64 MiB 64 MiB 2024-09-17T07:55:50.041 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 '!=' 0 ']' 2024-09-17T07:55:50.041 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:55:50.223 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2024-09-17T07:55:50.219+0000 7fb18e202700 0 -- 172.21.15.184:0/326905411 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7fb174006720 msgr2=0x7fb174015390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:50.269 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 100% complete...done. 2024-09-17T07:55:50.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:55:50.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:55:50.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:55:50.274 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:55:50.309 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:55:50.310 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2024-09-17T07:55:50.861 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete...2024-09-17T07:55:50.855+0000 7fac75cdb700 0 -- 172.21.15.184:0/1856338892 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fac64002300 msgr2=0x55c417455600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:55:50.944 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 5% complete...2024-09-17T07:55:50.939+0000 7fac75cdb700 0 -- 172.21.15.184:0/1856338892 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7fac5803aac0 msgr2=0x7fac5803cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:56:02.157 INFO:tasks.workunit.client.0.smithi184.stderr: Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete... Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-17T07:56:02.175 INFO:tasks.workunit.client.0.smithi184.stderr:+ count=0 2024-09-17T07:56:02.175 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret= 2024-09-17T07:56:02.175 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 -lt 10 ']' 2024-09-17T07:56:02.175 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:56:02.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:56:02.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ tr -s ' ' 2024-09-17T07:56:02.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ cut -d ' ' -f 4-5 2024-09-17T07:56:02.176 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^4 GiB' 2024-09-17T07:56:02.225 INFO:tasks.workunit.client.0.smithi184.stdout:4 GiB 2024-09-17T07:56:02.226 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret=0 2024-09-17T07:56:02.226 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 = 0 ']' 2024-09-17T07:56:02.226 INFO:tasks.workunit.client.0.smithi184.stderr:+ break 2024-09-17T07:56:02.226 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd du 2024-09-17T07:56:02.277 INFO:tasks.workunit.client.0.smithi184.stdout:NAME PROVISIONED USED 2024-09-17T07:56:02.277 INFO:tasks.workunit.client.0.smithi184.stdout:test1 4 GiB 4 GiB 2024-09-17T07:56:02.281 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 '!=' 0 ']' 2024-09-17T07:56:02.282 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd rm test1 2024-09-17T07:56:02.499 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 1% complete... Removing image: 2% complete...2024-09-17T07:56:02.495+0000 7f6547136700 0 -- 172.21.15.184:0/2868960562 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f652c008af0 msgr2=0x7f652c00af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:56:02.519 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 3% complete... Removing image: 4% complete...2024-09-17T07:56:02.515+0000 7f6547136700 0 -- 172.21.15.184:0/2868960562 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f652803a8e0 msgr2=0x7f652803cd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:56:03.526 INFO:tasks.workunit.client.0.smithi184.stderr: Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-17T07:56:03.530 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd ls 2024-09-17T07:56:03.531 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test1 2024-09-17T07:56:03.531 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:56:03.531 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:56:03.570 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:56:03.570 INFO:tasks.workunit.client.0.smithi184.stderr:+ test_namespace 2024-09-17T07:56:03.570 INFO:tasks.workunit.client.0.smithi184.stdout:testing namespace... 2024-09-17T07:56:03.571 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'testing namespace...' 2024-09-17T07:56:03.571 INFO:tasks.workunit.client.0.smithi184.stderr:+ remove_images 2024-09-17T07:56:03.571 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:03.702 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:03.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:03.960 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:04.098 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:04.233 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:04.365 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:04.496 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:04.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:04.783 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:04.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:05.060 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:05.202 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:05.553 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:05.688 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:05.832 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:05.981 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:06.128 INFO:tasks.workunit.client.0.smithi184.stderr:+ for img in $IMGS 2024-09-17T07:56:06.271 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace ls 2024-09-17T07:56:06.271 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:56:06.272 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^0$' 2024-09-17T07:56:06.312 INFO:tasks.workunit.client.0.smithi184.stdout:0 2024-09-17T07:56:06.313 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace create rbd/test1 2024-09-17T07:56:06.373 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace create --pool rbd --namespace test2 2024-09-17T07:56:06.425 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace create --namespace test3 2024-09-17T07:56:06.479 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd namespace create rbd/test3 2024-09-17T07:56:06.479 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace create rbd/test3 2024-09-17T07:56:06.519 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: failed to created namespace: 2024-09-17T07:56:06.515+0000 7f6125ea54c0 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2024-09-17T07:56:06.519 INFO:tasks.workunit.client.0.smithi184.stderr:(17) File exists 2024-09-17T07:56:06.524 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:56:06.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep test 2024-09-17T07:56:06.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ wc -l 2024-09-17T07:56:06.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace list 2024-09-17T07:56:06.525 INFO:tasks.workunit.client.0.smithi184.stderr:+ grep '^3$' 2024-09-17T07:56:06.565 INFO:tasks.workunit.client.0.smithi184.stdout:3 2024-09-17T07:56:06.566 INFO:tasks.workunit.client.0.smithi184.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2024-09-17T07:56:06.566 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd namespace remove --pool rbd missing 2024-09-17T07:56:06.593 INFO:tasks.workunit.client.0.smithi184.stderr:rbd: namespace name was not specified 2024-09-17T07:56:06.594 INFO:tasks.workunit.client.0.smithi184.stderr:+ return 0 2024-09-17T07:56:06.594 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2024-09-17T07:56:06.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2024-09-17T07:56:06.748 INFO:tasks.workunit.client.0.smithi184.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2024-09-17T07:56:06.912 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:56:06.907+0000 7f3dd8a64700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55ba0bbf7e90 msgr2=0x55ba0bbfa270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:56:07.427 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:56:07.423+0000 7f3dd9265700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55ba0bbf7e90 msgr2=0x7f3db80413f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T07:56:07.431 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:56:07.427+0000 7f3dd8a64700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55ba0bb921f0 msgr2=0x7f3db808fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:56:07.843 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T07:56:07.839+0000 7f3dd8a64700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x55ba0bb921f0 msgr2=0x7f3db808fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T07:56:38.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:38.274+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:38.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:38.282+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:39.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:39.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:39.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:39.302+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:40.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:40.222+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:40.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:40.286+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:41.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:41.222+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:41.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:41.322+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:42.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:42.230+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:42.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:42.342+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:43.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:43.266+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:43.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:43.302+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:44.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:44.230+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:44.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:44.342+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:45.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:45.242+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:45.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:45.310+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:46.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:46.234+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:46.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:46.298+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:47.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:47.214+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:47.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:47.298+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:48.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:48.202+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:48.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:48.306+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:49.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:49.154+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:49.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:49.326+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:50.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:50.174+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:50.296 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:50.290+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:51.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:51.174+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:51.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:51.338+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:52.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:52.214+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:52.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:52.298+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:53.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:53.226+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:53.337 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:53.334+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:54.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:54.226+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:54.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:54.314+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:55.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:55.193+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:55.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:55.277+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:56.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:56.213+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:56.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:56.233+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:57.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:57.181+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:57.278 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:57.273+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:58.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:58.209+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:58.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:58.269+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:59.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:56:59.209+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:56:59.256 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:56:59.249+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:00.214 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:00.209+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:00.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:00.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:01.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:01.213+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:01.246 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:01.241+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:02.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:02.209+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:02.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:02.233+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:03.192 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:03.189+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:03.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:03.257+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:04.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:04.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:04.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:04.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:05.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:05.229+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:05.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:05.261+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:06.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:06.269+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:06.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:06.297+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:07.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:07.245+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:07.300 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:07.297+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:08.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:08.249+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:08.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:08.325+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:09.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:09.297+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:09.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:09.329+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:10.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:10.329+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:10.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:10.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:11.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:11.361+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:11.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:11.393+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:12.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:12.397+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:12.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:12.429+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:13.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:13.409+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:13.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:13.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:14.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:14.401+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:14.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:14.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:15.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:15.385+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:15.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:15.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:16.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:16.405+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:16.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:16.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:17.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:17.437+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:17.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:17.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:18.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:18.409+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:18.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:18.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:19.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:19.417+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:19.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:19.449+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:20.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:20.397+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:20.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:20.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:21.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:21.429+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:21.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:21.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:22.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:22.389+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:22.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:22.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:23.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:23.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:23.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:23.461+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:24.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:24.461+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:24.480 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:24.477+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:25.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:25.445+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:25.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:25.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:26.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:26.437+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:26.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:26.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:27.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:27.465+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:27.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:27.497+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:28.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:28.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:28.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:28.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:29.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:29.437+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:29.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:29.537+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:30.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:30.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:30.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:30.497+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:31.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:31.413+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:31.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:31.477+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:32.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:32.389+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:32.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:32.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:33.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:33.401+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:33.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:33.445+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:34.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:34.441+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:34.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:34.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:35.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:35.493+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:35.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:35.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:36.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:36.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:36.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:36.509+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:37.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:37.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:37.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:37.513+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:38.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:38.465+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:38.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:38.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:39.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:39.445+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:39.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:39.497+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:40.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:40.416+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:40.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:40.452+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:41.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:41.444+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:41.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:41.464+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:42.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:42.484+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:42.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:42.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:43.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:43.524+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:43.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:43.532+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:44.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:44.512+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:44.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:44.580+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:45.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:45.532+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:45.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:45.560+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:46.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:46.488+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:46.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:46.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:47.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:47.472+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:47.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:47.532+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:48.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:48.488+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:48.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:48.496+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:49.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:49.496+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:49.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:49.528+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:50.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:50.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:50.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:50.512+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:51.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:51.532+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:51.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:51.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:52.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:52.528+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:52.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:52.544+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:53.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:53.520+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:53.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:53.536+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:54.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:54.492+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:54.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:54.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:55.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:55.512+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:55.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:55.516+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:56.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:56.508+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:56.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:56.508+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:57.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:57.468+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:57.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:57.488+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:58.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:58.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:58.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:58.540+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:59.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:57:59.516+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:57:59.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:57:59.548+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:00.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:00.472+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:00.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:00.572+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:01.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:01.444+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:01.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:01.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:02.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:02.412+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:02.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:02.596+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:03.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:03.396+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:03.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:03.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:04.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:04.448+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:04.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:04.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:05.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:05.460+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:05.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:05.656+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:06.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:06.432+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:06.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:06.692+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:07.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:07.460+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:07.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:07.728+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:08.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:08.508+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:08.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:08.728+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:09.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:09.528+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:09.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:09.760+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:10.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:10.488+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:10.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:10.716+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:11.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:11.504+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:11.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:11.696+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:12.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:12.540+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:12.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:12.660+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:13.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:13.520+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:13.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:13.620+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:14.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:14.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:14.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:14.664+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:15.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:15.548+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:15.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:15.656+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:16.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:16.576+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:16.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:16.660+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:17.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:17.564+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:17.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:17.676+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:18.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:18.608+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:18.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:18.656+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:19.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:19.620+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:19.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:19.628+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:20.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:20.640+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:20.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:20.656+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:21.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:21.620+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:21.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:21.684+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:22.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:22.612+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:22.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:22.680+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:23.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:23.652+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:23.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:23.656+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:24.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:24.639+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:24.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:24.663+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:25.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:25.627+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:25.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:25.711+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:26.583 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:26.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:26.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:26.723+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:27.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:27.555+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:27.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:27.683+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:28.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:28.519+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:28.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:28.719+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:29.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:29.491+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:29.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:29.699+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:30.500 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:30.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:30.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:30.683+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:31.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:31.455+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:31.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:31.687+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:32.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:32.427+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:32.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:32.687+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:33.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:33.463+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:33.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:33.675+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:34.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:34.511+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:34.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:34.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:35.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:35.527+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:35.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:35.691+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:36.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:36.571+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:36.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:36.739+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:37.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:37.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:37.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:37.763+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:38.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:38.547+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:38.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:38.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:39.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:39.591+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:39.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:39.791+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:40.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:40.587+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:40.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:40.791+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:41.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:41.587+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:41.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:41.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:42.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:42.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:42.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:42.751+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:43.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:43.523+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:43.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:43.767+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:44.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:44.499+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:44.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:44.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:45.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:45.523+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:45.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:45.723+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:46.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:46.499+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:46.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:46.763+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:47.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:47.551+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:47.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:47.815+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:48.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:48.583+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:48.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:48.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:49.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:49.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:49.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:49.743+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:50.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:50.631+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:50.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:50.779+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:51.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:51.647+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:51.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:51.779+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:52.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:52.679+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:52.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:52.811+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:53.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:53.731+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:53.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:53.819+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:54.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:54.731+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:54.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:54.867+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:55.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:55.735+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:55.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:55.883+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:56.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:56.751+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:56.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:56.927+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:57.747 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:57.743+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:57.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:57.911+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:58.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:58.739+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:58.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:58.939+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:59.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:58:59.711+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:58:59.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:58:59.979+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:00.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:00.723+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:00.983 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:00.979+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:01.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:01.703+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:02.030 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:02.027+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:02.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:02.699+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:03.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:03.047+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:03.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:03.747+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:04.059 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:04.055+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:04.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:04.771+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:05.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:05.023+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:05.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:05.739+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:06.013 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:06.007+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:06.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:06.743+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:07.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:07.047+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:07.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:07.731+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:08.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:08.035+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:08.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:08.775+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:09.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:09.066+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:09.806 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:09.802+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:10.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:10.058+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:10.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:10.818+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:11.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:11.066+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:11.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:11.794+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:12.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:12.062+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:12.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:12.754+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:13.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:13.106+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:13.786 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:13.782+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:14.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:14.130+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:14.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:14.754+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:15.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:15.166+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:15.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:15.802+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:16.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:16.162+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:16.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:16.770+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:17.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:17.150+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:17.828 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:17.822+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:18.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:18.150+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:18.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:18.814+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:19.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:19.186+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:19.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:19.814+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:20.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:20.194+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:20.846 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:20.842+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:21.170 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:21.166+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:21.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:21.818+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:22.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:22.150+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:22.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:22.770+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:23.145 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:23.138+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:23.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:23.822+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:24.167 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:24.162+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:24.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:24.810+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:25.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:25.126+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:25.783 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:25.778+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:26.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:26.110+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:26.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:26.822+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:27.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:27.150+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:27.790 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:27.786+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:28.159 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:28.154+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:28.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:28.818+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:29.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:29.118+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:29.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:29.862+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:30.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:30.114+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:30.856 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:30.850+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:31.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:31.082+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:31.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:31.886+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:32.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:32.102+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:32.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:32.838+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:33.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:33.110+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:33.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:33.882+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:34.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:34.110+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:34.902 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:34.898+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:35.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:35.082+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:35.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:35.914+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:36.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:36.070+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:36.928 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:36.922+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:37.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:37.038+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:37.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:37.902+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:38.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:38.066+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:38.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:38.918+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:39.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:39.062+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:39.910 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:39.906+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:40.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:40.026+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:40.885 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:40.878+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:41.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:41.026+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:41.931 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:41.926+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:42.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:42.058+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:42.922 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:42.918+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:43.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:43.046+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:43.874 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:43.870+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:44.052 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:44.046+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:44.912 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:44.906+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:45.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:45.022+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:45.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:45.886+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:46.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:46.070+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:46.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:46.854+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:47.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:47.082+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:47.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:47.838+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:48.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:48.078+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:48.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:48.806+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:49.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:49.070+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:49.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:49.850+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:50.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:50.102+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:50.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:50.818+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:51.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:51.110+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:51.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:51.830+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:52.166 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:52.162+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:52.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:52.814+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:53.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:53.162+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:53.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:53.825+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:54.186 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:54.181+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:54.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:54.817+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:55.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:55.133+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:55.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:55.813+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:56.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:56.133+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:56.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:56.813+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:57.123 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:57.117+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:57.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:57.769+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:58.084 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:58.077+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:58.790 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:58.785+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:59.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T07:59:59.117+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T07:59:59.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T07:59:59.745+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:00.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:00.173+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:00.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:00.785+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:01.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:01.157+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:01.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:01.761+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:02.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:02.181+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:02.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:02.713+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:03.192 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:03.189+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:03.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:03.685+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:04.146 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:04.145+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:04.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:04.665+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:05.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:05.193+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:05.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:05.641+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:06.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:06.217+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:06.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:06.617+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:07.214 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:07.213+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:07.621 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:07.617+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:08.180 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:08.177+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:08.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:08.617+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:09.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:09.173+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:09.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:09.593+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:10.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:10.205+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:10.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:10.553+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:11.210 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:11.209+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:11.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:11.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:12.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:12.233+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:12.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:12.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:13.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:13.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:13.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:13.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:14.203 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:14.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:14.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:14.461+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:15.245 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:15.241+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:15.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:15.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:16.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:16.285+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:16.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:16.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:17.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:17.281+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:17.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:17.517+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:18.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:18.285+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:18.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:18.509+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:19.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:19.321+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:19.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:19.521+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:20.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:20.309+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:20.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:20.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:21.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:21.341+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:21.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:21.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:22.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:22.361+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:22.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:22.645+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:23.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:23.369+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:23.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:23.621+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:24.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:24.345+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:24.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:24.669+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:25.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:25.385+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:25.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:25.705+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:26.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:26.373+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:26.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:26.673+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:27.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:27.377+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:27.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:27.653+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:28.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:28.345+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:28.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:28.613+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:29.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:29.373+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:29.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:29.577+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:30.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:30.401+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:30.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:30.545+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:31.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:31.409+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:31.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:31.545+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:32.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:32.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:32.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:32.553+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:33.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:33.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:33.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:33.553+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:34.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:34.437+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:34.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:34.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:35.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:35.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:35.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:35.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:36.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:36.401+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:36.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:36.561+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:37.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:37.361+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:37.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:37.548+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:38.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:38.412+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:38.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:38.548+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:39.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:39.436+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:39.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:39.596+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:40.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:40.444+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:40.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:40.628+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:41.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:41.436+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:41.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:41.664+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:42.480 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:42.476+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:42.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:42.696+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:43.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:43.508+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:43.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:43.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:44.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:44.540+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:44.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:44.680+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:45.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:45.556+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:45.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:45.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:46.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:46.540+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:46.769 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:46.764+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:47.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:47.580+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:47.810 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:47.808+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:48.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:48.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:48.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:48.816+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:49.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:49.544+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:49.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:49.864+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:50.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:50.580+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:50.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:50.848+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:51.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:51.564+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:51.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:51.840+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:52.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:52.576+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:52.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:52.828+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:53.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:53.564+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:53.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:53.828+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:54.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:54.596+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:54.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:54.816+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:55.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:55.564+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:55.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:55.824+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:56.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:56.524+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:56.838 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:56.836+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:57.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:57.564+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:57.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:57.836+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:58.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:58.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:58.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:58.836+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:59.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:00:59.624+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:00:59.886 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:00:59.884+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:00.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:00.636+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:00.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:00.852+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:01.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:01.620+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:01.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:01.816+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:02.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:02.636+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:02.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:02.788+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:03.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:03.660+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:03.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:03.792+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:04.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:04.684+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:04.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:04.752+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:05.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:05.652+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:05.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:05.752+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:06.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:06.612+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:06.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:06.756+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:07.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:07.620+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:07.715 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:07.712+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:08.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:08.620+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:08.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:08.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:09.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:09.604+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:09.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:09.696+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:10.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:10.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:10.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:10.732+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:11.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:11.572+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:11.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:11.748+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:12.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:12.584+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:12.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:12.764+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:13.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:13.636+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:13.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:13.812+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:14.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:14.640+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:14.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:14.776+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:15.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:15.656+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:15.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:15.772+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:16.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:16.620+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:16.747 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:16.744+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:17.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:17.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:17.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:17.792+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:18.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:18.588+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:18.835 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:18.832+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:19.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:19.580+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:19.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:19.804+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:20.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:20.588+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:20.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:20.804+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:21.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:21.635+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:21.828 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:21.823+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:22.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:22.615+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:22.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:22.847+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:23.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:23.655+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:23.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:23.891+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:24.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:24.679+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:24.915 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:24.911+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:25.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:25.643+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:25.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:25.959+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:26.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:26.603+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:26.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:26.919+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:27.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:27.603+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:27.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:27.903+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:28.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:28.619+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:28.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:28.895+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:29.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:29.615+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:29.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:29.927+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:30.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:30.659+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:30.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:30.931+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:31.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:31.659+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:31.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:31.963+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:32.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:32.675+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:32.987 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:32.983+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:33.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:33.663+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:34.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:34.031+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:34.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:34.679+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:35.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:35.027+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:35.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:35.723+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:36.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:36.035+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:36.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:36.747+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:37.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:37.063+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:37.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:37.779+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:38.108 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:38.103+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:38.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:38.735+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:39.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:39.131+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:39.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:39.755+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:40.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:40.155+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:40.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:40.747+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:41.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:41.163+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:41.791 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:41.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:42.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:42.163+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:42.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:42.743+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:43.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:43.207+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:43.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:43.771+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:44.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:44.227+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:44.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:44.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:45.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:45.255+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:45.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:45.739+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:46.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:46.291+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:46.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:46.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:47.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:47.283+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:47.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:47.799+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:48.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:48.307+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:48.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:48.767+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:49.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:49.323+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:49.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:49.807+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:50.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:50.355+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:50.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:50.803+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:51.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:51.395+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:51.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:51.763+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:52.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:52.347+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:52.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:52.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:53.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:53.351+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:53.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:53.711+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:54.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:54.311+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:54.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:54.731+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:55.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:55.271+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:55.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:55.687+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:56.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:56.227+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:56.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:56.667+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:57.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:57.231+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:57.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:57.699+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:58.219 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:58.215+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:58.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:58.731+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:59.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:01:59.235+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:01:59.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:01:59.759+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:00.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:00.223+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:00.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:00.759+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:01.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:01.239+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:01.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:01.803+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:02.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:02.211+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:02.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:02.779+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:03.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:03.211+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:03.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:03.815+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:04.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:04.255+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:04.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:04.855+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:05.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:05.271+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:05.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:05.814+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:06.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:06.314+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:06.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:06.826+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:07.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:07.350+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:07.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:07.862+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:08.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:08.310+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:08.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:08.910+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:09.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:09.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:09.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:09.926+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:10.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:10.266+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:10.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:10.914+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:11.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:11.238+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:11.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:11.962+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:12.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:12.202+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:12.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:12.934+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:13.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:13.210+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:13.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:13.890+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:14.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:14.254+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:14.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:14.858+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:15.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:15.238+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:15.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:15.878+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:16.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:16.222+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:16.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:16.866+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:17.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:17.250+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:17.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:17.878+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:18.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:18.286+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:18.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:18.926+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:19.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:19.290+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:19.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:19.970+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:20.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:20.274+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:20.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:20.962+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:21.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:21.294+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:21.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:21.950+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:22.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:22.274+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:22.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:22.914+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:23.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:23.286+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:23.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:23.946+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:24.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:24.262+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:25.000 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:24.994+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:25.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:25.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:26.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:26.014+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:26.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:26.262+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:27.022 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:27.018+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:27.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:27.286+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:27.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:27.990+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:28.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:28.322+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:29.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:29.022+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:29.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:29.326+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:29.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:29.990+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:30.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:30.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:31.010 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:31.006+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:31.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:31.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:32.009 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:32.002+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:32.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:32.322+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:32.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:32.974+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:33.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:33.326+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:34.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:34.018+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:34.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:34.310+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:35.030 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:35.026+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:35.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:35.350+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:36.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:36.062+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:36.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:36.334+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:37.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:37.030+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:37.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:37.306+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:38.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:38.054+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:38.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:38.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:39.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:39.070+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:39.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:39.278+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:40.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:40.122+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:40.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:40.238+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:41.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:41.082+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:41.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:41.270+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:42.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:42.070+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:42.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:42.250+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:43.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:43.086+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:43.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:43.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:44.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:44.050+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:44.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:44.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:45.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:45.066+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:45.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:45.286+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:46.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:46.038+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:46.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:46.250+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:47.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:47.014+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:47.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:47.230+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:48.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:48.014+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:48.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:48.242+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:49.007 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:49.002+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:49.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:49.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:50.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:50.045+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:50.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:50.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:51.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:51.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:51.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:51.245+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:52.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:52.121+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:52.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:52.245+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:53.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:53.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:53.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:53.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:54.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:54.061+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:54.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:54.257+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:55.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:55.045+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:55.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:55.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:56.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:56.021+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:56.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:56.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:57.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:57.065+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:57.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:57.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:58.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:58.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:58.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:58.325+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:59.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:02:59.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:02:59.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:02:59.365+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:00.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:00.185+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:00.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:00.369+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:01.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:01.161+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:01.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:01.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:02.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:02.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:02.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:02.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:03.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:03.113+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:03.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:03.361+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:04.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:04.077+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:04.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:04.317+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:05.085 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:05.081+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:05.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:05.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:06.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:06.041+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:06.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:06.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:07.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:07.069+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:07.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:07.381+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:08.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:08.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:08.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:08.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:09.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:09.077+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:09.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:09.365+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:10.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:10.065+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:10.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:10.329+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:11.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:11.041+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:11.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:11.297+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:12.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:12.021+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:12.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:12.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:13.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:13.001+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:13.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:13.245+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:13.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:13.981+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:14.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:14.293+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:15.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:15.025+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:15.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:15.321+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:16.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:16.045+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:16.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:16.341+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:17.064 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:17.061+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:17.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:17.309+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:18.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:18.029+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:18.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:18.261+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:19.030 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:19.025+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:19.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:19.265+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:20.054 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:20.053+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:20.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:20.225+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:21.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:21.029+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:21.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:21.249+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:22.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:22.037+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:22.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:22.241+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:23.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:23.021+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:23.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:23.233+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:24.059 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:24.057+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:24.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:24.261+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:25.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:25.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:25.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:25.269+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:26.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:26.077+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:26.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:26.237+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:27.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:27.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:27.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:27.209+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:28.082 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:28.081+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:28.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:28.237+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:29.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:29.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:29.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:29.257+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:30.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:30.125+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:30.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:30.273+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:31.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:31.149+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:31.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:31.245+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:32.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:32.133+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:32.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:32.249+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:33.111 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:33.109+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:33.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:33.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:34.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:34.112+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:34.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:34.308+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:35.128 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:35.124+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:35.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:35.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:36.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:36.084+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:36.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:36.372+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:37.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:37.096+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:37.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:37.384+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:38.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:38.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:38.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:38.420+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:39.162 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:39.160+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:39.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:39.456+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:40.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:40.112+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:40.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:40.412+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:41.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:41.068+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:41.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:41.448+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:42.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:42.064+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:42.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:42.460+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:43.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:43.064+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:43.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:43.488+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:44.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:44.044+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:44.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:44.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:45.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:45.036+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:45.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:45.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:46.019 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:46.016+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:46.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:46.472+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:47.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:47.052+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:47.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:47.444+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:48.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:48.100+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:48.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:48.464+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:49.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:49.144+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:49.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:49.468+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:50.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:50.112+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:50.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:50.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:51.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:51.092+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:51.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:51.524+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:52.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:52.132+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:52.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:52.568+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:53.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:53.176+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:53.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:53.544+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:54.205 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:54.200+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:54.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:54.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:55.193 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:55.188+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:55.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:55.492+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:56.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:56.236+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:56.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:56.468+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:57.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:57.272+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:57.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:57.452+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:58.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:58.280+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:58.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:58.432+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:59.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:03:59.292+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:03:59.403 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:03:59.400+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:00.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:00.244+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:00.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:00.364+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:01.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:01.288+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:01.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:01.384+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:02.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:02.268+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:02.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:02.348+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:03.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:03.244+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:03.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:03.396+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:04.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:04.244+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:04.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:04.408+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:05.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:05.200+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:05.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:05.368+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:06.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:06.212+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:06.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:06.372+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:07.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:07.252+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:07.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:07.416+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:08.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:08.288+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:08.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:08.420+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:09.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:09.296+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:09.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:09.396+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:10.296 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:10.292+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:10.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:10.416+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:11.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:11.272+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:11.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:11.392+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:12.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:12.264+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:12.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:12.360+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:13.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:13.240+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:13.325 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:13.320+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:14.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:14.272+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:14.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:14.340+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:15.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:15.296+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:15.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:15.320+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:16.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:16.292+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:16.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:16.340+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:17.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:17.312+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:17.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:17.372+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:18.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:18.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:18.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:18.339+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:19.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:19.363+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:19.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:19.363+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:20.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:20.363+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:20.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:20.363+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:21.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:21.399+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:21.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:21.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:22.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:22.423+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:22.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:22.447+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:23.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:23.379+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:23.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:23.415+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:24.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:24.423+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:24.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:24.435+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:25.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:25.431+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:25.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:25.479+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:26.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:26.423+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:26.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:26.511+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:27.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:27.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:27.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:27.531+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:28.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:28.419+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:28.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:28.491+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:29.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:29.379+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:29.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:29.527+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:30.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:30.391+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:30.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:30.531+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:31.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:31.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:31.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:31.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:32.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:32.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:32.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:32.487+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:33.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:33.487+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:33.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:33.491+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:34.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:34.439+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:34.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:34.471+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:35.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:35.447+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:35.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:35.451+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:36.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:36.471+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:36.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:36.479+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:37.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:37.427+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:37.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:37.483+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:38.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:38.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:38.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:38.467+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:39.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:39.423+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:39.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:39.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:40.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:40.435+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:40.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:40.511+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:41.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:41.403+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:41.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:41.523+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:42.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:42.355+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:42.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:42.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:43.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:43.355+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:43.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:43.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:44.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:44.379+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:44.650 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:44.647+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:45.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:45.395+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:45.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:45.603+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:46.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:46.399+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:46.656 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:46.651+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:47.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:47.447+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:47.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:47.639+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:48.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:48.419+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:48.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:48.663+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:49.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:49.435+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:49.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:49.707+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:50.410 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:50.407+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:50.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:50.683+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:51.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:51.415+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:51.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:51.695+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:52.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:52.443+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:52.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:52.699+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:53.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:53.443+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:53.679 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:53.675+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:54.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:54.451+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:54.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:54.695+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:55.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:55.479+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:55.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:55.651+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:56.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:56.463+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:56.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:56.659+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:57.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:57.511+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:57.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:57.699+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:58.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:58.519+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:58.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:58.743+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:59.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:04:59.507+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:04:59.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:04:59.779+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:00.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:00.547+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:00.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:00.827+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:01.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:01.567+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:01.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:01.815+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:02.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:02.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:02.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:02.794+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:03.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:03.622+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:03.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:03.778+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:04.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:04.606+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:04.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:04.790+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:05.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:05.646+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:05.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:05.774+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:06.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:06.626+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:06.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:06.806+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:07.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:07.646+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:07.822 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:07.818+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:08.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:08.630+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:08.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:08.770+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:09.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:09.658+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:09.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:09.730+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:10.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:10.670+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:10.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:10.734+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:11.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:11.650+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:11.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:11.746+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:12.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:12.670+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:12.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:12.706+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:13.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:13.622+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:13.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:13.718+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:14.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:14.642+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:14.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:14.758+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:15.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:15.610+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:15.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:15.774+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:16.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:16.606+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:16.815 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:16.810+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:17.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:17.626+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:17.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:17.782+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:18.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:18.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:18.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:18.750+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:19.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:19.630+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:19.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:19.766+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:20.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:20.594+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:20.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:20.762+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:21.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:21.594+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:21.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:21.714+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:22.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:22.626+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:22.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:22.746+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:23.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:23.582+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:23.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:23.722+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:24.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:24.602+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:24.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:24.726+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:25.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:25.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:25.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:25.758+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:26.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:26.606+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:26.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:26.734+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:27.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:27.642+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:27.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:27.722+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:28.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:28.614+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:28.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:28.742+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:29.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:29.578+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:29.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:29.698+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:30.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:30.598+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:30.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:30.674+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:31.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:31.626+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:31.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:31.690+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:32.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:32.654+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:32.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:32.726+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:33.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:33.614+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:33.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:33.770+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:34.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:34.638+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:34.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:34.810+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:35.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:35.650+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:35.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:35.798+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:36.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:36.630+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:36.762 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:36.758+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:37.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:37.670+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:37.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:37.770+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:38.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:38.666+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:38.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:38.782+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:39.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:39.618+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:39.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:39.766+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:40.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:40.662+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:40.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:40.786+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:41.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:41.682+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:41.744 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:41.738+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:42.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:42.698+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:42.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:42.730+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:43.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:43.706+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:43.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:43.710+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:44.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:44.674+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:44.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:44.678+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:45.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:45.658+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:45.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:45.722+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:46.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:46.689+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:46.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:46.769+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:47.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:47.657+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:47.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:47.745+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:48.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:48.641+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:48.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:48.745+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:49.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:49.617+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:49.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:49.717+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:50.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:50.581+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:50.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:50.677+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:51.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:51.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:51.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:51.653+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:52.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:52.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:52.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:52.617+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:53.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:53.541+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:53.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:53.585+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:54.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:54.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:54.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:54.561+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:55.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:55.521+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:55.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:55.597+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:56.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:56.537+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:56.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:56.597+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:57.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:57.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:57.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:57.597+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:58.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:58.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:58.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:58.609+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:59.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:05:59.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:05:59.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:05:59.569+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:00.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:00.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:00.606 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:00.605+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:01.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:01.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:01.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:01.617+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:02.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:02.461+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:02.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:02.637+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:03.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:03.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:03.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:03.657+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:04.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:04.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:04.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:04.661+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:05.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:05.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:05.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:05.653+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:06.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:06.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:06.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:06.689+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:07.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:07.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:07.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:07.653+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:08.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:08.517+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:08.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:08.641+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:09.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:09.545+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:09.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:09.617+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:10.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:10.513+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:10.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:10.665+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:11.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:11.557+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:11.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:11.665+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:12.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:12.565+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:12.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:12.621+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:13.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:13.521+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:13.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:13.617+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:14.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:14.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:14.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:14.653+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:15.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:15.569+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:15.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:15.645+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:16.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:16.561+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:16.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:16.625+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:17.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:17.525+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:17.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:17.649+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:18.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:18.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:18.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:18.701+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:19.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:19.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:19.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:19.729+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:20.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:20.461+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:20.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:20.709+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:21.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:21.417+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:21.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:21.701+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:22.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:22.385+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:22.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:22.709+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:23.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:23.425+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:23.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:23.697+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:24.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:24.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:24.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:24.725+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:25.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:25.445+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:25.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:25.757+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:26.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:26.489+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:26.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:26.805+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:27.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:27.537+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:27.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:27.821+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:28.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:28.489+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:28.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:28.845+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:29.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:29.509+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:29.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:29.853+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:30.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:30.544+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:30.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:30.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:31.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:31.528+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:31.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:31.892+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:32.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:32.540+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:32.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:32.908+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:33.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:33.536+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:33.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:33.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:34.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:34.560+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:34.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:34.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:35.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:35.516+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:35.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:35.848+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:36.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:36.512+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:36.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:36.848+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:37.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:37.504+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:37.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:37.848+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:38.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:38.528+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:38.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:38.872+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:39.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:39.516+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:39.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:39.868+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:40.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:40.476+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:40.828 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:40.824+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:41.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:41.488+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:41.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:41.860+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:42.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:42.444+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:42.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:42.828+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:43.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:43.404+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:43.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:43.804+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:44.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:44.404+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:44.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:44.848+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:45.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:45.388+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:45.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:45.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:46.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:46.420+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:46.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:46.920+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:47.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:47.436+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:47.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:47.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:48.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:48.408+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:48.868 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:48.864+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:49.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:49.388+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:49.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:49.912+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:50.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:50.400+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:50.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:50.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:51.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:51.412+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:51.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:51.920+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:52.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:52.400+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:52.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:52.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:53.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:53.408+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:54.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:54.000+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:54.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:54.412+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:54.985 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:54.980+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:55.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:55.444+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:56.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:56.000+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:56.500 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:56.496+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:56.978 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:56.976+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:57.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:57.512+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:58.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:57.996+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:58.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:58.508+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:58.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:58.976+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:59.480 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:06:59.476+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:06:59.981 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:06:59.976+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:00.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:00.440+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:00.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:00.936+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:01.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:01.448+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:01.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:01.944+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:02.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:02.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:02.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:02.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:03.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:03.512+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:03.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:03.956+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:04.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:04.492+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:04.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:04.912+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:05.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:05.540+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:05.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:05.872+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:06.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:06.572+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:06.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:06.908+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:07.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:07.592+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:07.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:07.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:08.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:08.596+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:08.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:08.920+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:09.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:09.588+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:09.919 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:09.916+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:10.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:10.604+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:10.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:10.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:11.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:11.616+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:11.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:11.836+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:12.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:12.600+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:12.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:12.872+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:13.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:13.580+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:13.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:13.915+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:14.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:14.627+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:14.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:14.867+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:15.659 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:15.655+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:15.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:15.883+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:16.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:16.607+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:16.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:16.835+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:17.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:17.647+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:17.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:17.839+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:18.698 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:18.695+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:18.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:18.803+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:19.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:19.667+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:19.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:19.763+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:20.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:20.699+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:20.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:20.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:21.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:21.655+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:21.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:21.759+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:22.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:22.671+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:22.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:22.747+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:23.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:23.707+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:23.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:23.739+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:24.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:24.683+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:24.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:24.755+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:25.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:25.639+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:25.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:25.771+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:26.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:26.631+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:26.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:26.799+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:27.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:27.603+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:27.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:27.811+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:28.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:28.563+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:28.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:28.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:29.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:29.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:29.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:29.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:30.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:30.647+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:30.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:30.819+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:31.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:31.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:31.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:31.807+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:32.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:32.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:32.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:32.811+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:33.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:33.619+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:33.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:33.819+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:34.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:34.575+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:34.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:34.851+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:35.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:35.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:35.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:35.847+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:36.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:36.583+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:36.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:36.867+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:37.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:37.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:37.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:37.875+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:38.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:38.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:38.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:38.839+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:39.610 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:39.607+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:39.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:39.803+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:40.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:40.591+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:40.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:40.815+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:41.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:41.575+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:41.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:41.855+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:42.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:42.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:42.828 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:42.823+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:43.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:43.515+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:43.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:43.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:44.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:44.515+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:44.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:44.791+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:45.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:45.479+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:45.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:45.827+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:46.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:46.431+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:46.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:46.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:47.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:47.435+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:47.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:47.779+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:48.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:48.479+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:48.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:48.759+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:49.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:49.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:49.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:49.751+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:50.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:50.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:50.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:50.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:51.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:51.511+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:51.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:51.791+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:52.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:52.511+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:52.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:52.767+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:53.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:53.487+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:53.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:53.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:54.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:54.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:54.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:54.787+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:55.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:55.467+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:55.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:55.767+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:56.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:56.459+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:56.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:56.723+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:57.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:57.415+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:57.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:57.711+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:58.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:58.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:58.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:58.694+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:59.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:07:59.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:07:59.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:07:59.738+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:00.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:00.398+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:00.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:00.754+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:01.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:01.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:01.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:01.774+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:02.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:02.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:02.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:02.826+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:03.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:03.530+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:03.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:03.866+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:04.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:04.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:04.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:04.890+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:05.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:05.482+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:05.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:05.918+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:06.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:06.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:06.971 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:06.966+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:07.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:07.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:07.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:07.918+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:08.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:08.474+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:08.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:08.910+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:09.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:09.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:09.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:09.962+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:10.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:10.514+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:10.973 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:10.966+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:11.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:11.566+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:12.016 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:12.010+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:12.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:12.570+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:13.054 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:13.050+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:13.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:13.566+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:14.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:14.086+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:14.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:14.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:15.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:15.046+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:15.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:15.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:16.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:16.082+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:16.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:16.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:17.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:17.070+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:17.491 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:17.486+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:18.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:18.054+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:18.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:18.482+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:19.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:19.090+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:19.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:19.514+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:20.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:20.074+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:20.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:20.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:21.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:21.122+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:21.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:21.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:22.124 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:22.118+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:22.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:22.506+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:23.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:23.090+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:23.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:23.506+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:24.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:24.130+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:24.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:24.526+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:25.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:25.090+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:25.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:25.558+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:26.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:26.114+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:26.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:26.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:27.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:27.138+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:27.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:27.486+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:28.159 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:28.154+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:28.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:28.494+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:29.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:29.190+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:29.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:29.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:30.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:30.226+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:30.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:30.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:31.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:31.194+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:31.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:31.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:32.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:32.202+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:32.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:32.398+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:33.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:33.238+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:33.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:33.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:34.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:34.274+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:34.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:34.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:35.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:35.250+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:35.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:35.506+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:36.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:36.250+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:36.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:36.558+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:37.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:37.234+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:37.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:37.586+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:38.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:38.270+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:38.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:38.606+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:39.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:39.282+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:39.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:39.642+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:40.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:40.314+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:40.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:40.626+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:41.358 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:41.354+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:41.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:41.678+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:42.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:42.398+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:42.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:42.718+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:43.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:43.418+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:43.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:43.674+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:44.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:44.406+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:44.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:44.638+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:45.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:45.401+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:45.677 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:45.669+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:46.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:46.445+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:46.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:46.697+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:47.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:47.469+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:47.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:47.701+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:48.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:48.505+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:48.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:48.661+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:49.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:49.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:49.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:49.637+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:50.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:50.561+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:50.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:50.641+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:51.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:51.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:51.697 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:51.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:52.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:52.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:52.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:52.705+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:53.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:53.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:53.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:53.717+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:54.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:54.541+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:54.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:54.757+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:55.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:55.497+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:55.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:55.789+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:56.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:56.461+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:56.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:56.741+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:57.479 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:57.477+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:57.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:57.697+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:58.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:58.497+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:58.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:58.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:59.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:08:59.517+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:08:59.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:08:59.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:00.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:00.525+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:00.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:00.769+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:01.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:01.481+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:01.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:01.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:02.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:02.461+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:02.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:02.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:03.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:03.453+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:03.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:03.729+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:04.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:04.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:04.696 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:04.693+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:05.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:05.453+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:05.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:05.697+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:06.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:06.433+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:06.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:06.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:07.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:07.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:07.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:07.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:08.470 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:08.469+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:08.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:08.721+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:09.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:09.453+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:09.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:09.725+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:10.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:10.469+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:10.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:10.685+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:11.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:11.437+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:11.725 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:11.721+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:12.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:12.393+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:12.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:12.737+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:13.358 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:13.357+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:13.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:13.701+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:14.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:14.313+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:14.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:14.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:15.314 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:15.313+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:15.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:15.721+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:16.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:16.333+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:16.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:16.717+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:17.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:17.345+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:17.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:17.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:18.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:18.353+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:18.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:18.729+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:19.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:19.385+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:19.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:19.717+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:20.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:20.357+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:20.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:20.761+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:21.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:21.313+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:21.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:21.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:22.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:22.265+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:22.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:22.749+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:23.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:23.317+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:23.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:23.785+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:24.331 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:24.329+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:24.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:24.749+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:25.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:25.349+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:25.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:25.717+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:26.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:26.369+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:26.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:26.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:27.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:27.385+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:27.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:27.745+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:28.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:28.349+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:28.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:28.737+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:29.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:29.389+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:29.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:29.749+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:30.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:30.345+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:30.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:30.701+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:31.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:31.309+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:31.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:31.685+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:32.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:32.285+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:32.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:32.665+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:33.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:33.249+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:33.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:33.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:34.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:34.297+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:34.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:34.712+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:35.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:35.276+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:35.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:35.680+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:36.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:36.312+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:36.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:36.684+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:37.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:37.316+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:37.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:37.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:38.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:38.284+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:38.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:38.712+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:39.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:39.276+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:39.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:39.712+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:40.314 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:40.312+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:40.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:40.752+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:41.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:41.276+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:41.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:41.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:42.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:42.272+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:42.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:42.736+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:43.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:43.284+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:43.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:43.736+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:44.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:44.328+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:44.768 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:44.764+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:45.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:45.304+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:45.766 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:45.764+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:46.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:46.336+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:46.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:46.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:47.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:47.380+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:47.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:47.688+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:48.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:48.384+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:48.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:48.692+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:49.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:49.412+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:49.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:49.728+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:50.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:50.424+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:50.698 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:50.696+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:51.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:51.380+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:51.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:51.740+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:52.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:52.376+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:52.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:52.740+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:53.360 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:53.356+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:53.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:53.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:54.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:54.372+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:54.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:54.736+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:55.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:55.360+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:55.783 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:55.780+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:56.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:56.336+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:56.825 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:56.820+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:57.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:57.384+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:57.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:57.844+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:58.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:58.384+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:58.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:58.872+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:59.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:09:59.384+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:09:59.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:09:59.872+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:00.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:00.408+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:00.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:00.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:01.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:01.448+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:01.928 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:01.924+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:02.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:02.400+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:02.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:02.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:03.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:03.364+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:03.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:03.972+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:04.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:04.348+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:04.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:04.936+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:05.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:05.368+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:05.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:05.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:06.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:06.360+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:06.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:06.880+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:07.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:07.312+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:07.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:07.904+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:08.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:08.280+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:08.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:08.944+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:09.259 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:09.256+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:09.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:09.956+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:10.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:10.300+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:10.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:10.984+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:11.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:11.324+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:11.956 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:11.952+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:12.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:12.328+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:12.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:12.960+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:13.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:13.336+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:13.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:13.956+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:14.306 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:14.304+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:14.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:14.968+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:15.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:15.272+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:15.957 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:15.952+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:16.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:16.268+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:16.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:16.956+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:17.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:17.308+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:17.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:17.952+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:18.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:18.308+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:19.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:18.996+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:19.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:19.352+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:20.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:20.016+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:20.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:20.348+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:21.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:21.008+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:21.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:21.388+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:22.037 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:22.032+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:22.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:22.428+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:22.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:22.983+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:23.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:23.455+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:24.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:24.031+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:24.490 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:24.487+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:25.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:25.075+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:25.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:25.471+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:26.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:26.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:26.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:26.463+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:27.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:27.083+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:27.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:27.479+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:28.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:28.091+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:28.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:28.487+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:29.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:29.115+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:29.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:29.535+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:30.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:30.111+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:30.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:30.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:31.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:31.111+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:31.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:31.495+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:32.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:32.115+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:32.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:32.455+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:33.104 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:33.099+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:33.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:33.431+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:34.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:34.055+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:34.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:34.403+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:35.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:35.083+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:35.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:35.367+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:36.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:36.119+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:36.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:36.391+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:37.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:37.079+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:37.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:37.399+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:38.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:38.075+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:38.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:38.419+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:39.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:39.067+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:39.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:39.451+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:40.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:40.027+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:40.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:40.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:41.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:41.035+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:41.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:41.527+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:42.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:42.079+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:42.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:42.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:43.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:43.111+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:43.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:43.531+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:44.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:44.115+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:44.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:44.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:45.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:45.155+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:45.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:45.515+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:46.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:46.191+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:46.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:46.523+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:47.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:47.163+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:47.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:47.567+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:48.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:48.163+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:48.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:48.559+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:49.219 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:49.215+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:49.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:49.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:50.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:50.211+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:50.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:50.579+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:51.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:51.199+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:51.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:51.567+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:52.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:52.155+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:52.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:52.583+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:53.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:53.151+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:53.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:53.583+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:54.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:54.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:54.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:54.603+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:55.173 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:55.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:55.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:55.639+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:56.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:56.139+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:56.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:56.659+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:57.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:57.139+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:57.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:57.703+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:58.166 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:58.163+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:58.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:58.735+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:59.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:10:59.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:10:59.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:10:59.755+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:00.184 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:00.179+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:00.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:00.791+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:01.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:01.163+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:01.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:01.767+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:02.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:02.171+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:02.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:02.743+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:03.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:03.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:03.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:03.743+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:04.132 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:04.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:04.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:04.699+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:05.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:05.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:05.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:05.679+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:06.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:06.139+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:06.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:06.679+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:07.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:07.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:07.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:07.647+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:08.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:08.091+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:08.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:08.651+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:09.053 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:09.047+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:09.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:09.675+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:10.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:10.067+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:10.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:10.655+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:11.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:11.035+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:11.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:11.703+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:12.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:12.003+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:12.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:12.695+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:13.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:13.003+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:13.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:13.647+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:13.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:13.967+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:14.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:14.678+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:15.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:15.002+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:15.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:15.678+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:16.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:16.006+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:16.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:16.694+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:17.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:16.994+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:17.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:17.710+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:17.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:17.954+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:18.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:18.742+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:18.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:18.990+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:19.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:19.746+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:20.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:19.998+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:20.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:20.782+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:21.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:21.042+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:21.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:21.802+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:22.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:22.058+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:22.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:22.798+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:23.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:23.034+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:23.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:23.818+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:24.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:24.046+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:24.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:24.802+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:25.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:25.030+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:25.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:25.786+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:26.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:26.074+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:26.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:26.774+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:27.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:27.062+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:27.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:27.762+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:28.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:28.106+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:28.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:28.782+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:29.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:29.154+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:29.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:29.830+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:30.142 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:30.138+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:30.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:30.862+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:31.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:31.158+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:31.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:31.902+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:32.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:32.198+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:32.915 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:32.910+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:33.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:33.166+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:33.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:33.954+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:34.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:34.170+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:34.978 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:34.974+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:35.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:35.130+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:35.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:35.946+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:36.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:36.134+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:36.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:36.954+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:37.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:37.158+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:37.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:37.926+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:38.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:38.150+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:38.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:38.922+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:39.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:39.174+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:39.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:39.950+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:40.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:40.154+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:40.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:40.942+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:41.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:41.150+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:41.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:41.982+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:42.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:42.134+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:42.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:42.974+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:43.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:43.174+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:43.946 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:43.942+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:44.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:44.146+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:44.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:44.934+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:45.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:45.170+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:45.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:45.890+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:46.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:46.198+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:46.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:46.930+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:47.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:47.206+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:47.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:47.958+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:48.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:48.202+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:48.987 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:48.982+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:49.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:49.222+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:50.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:50.022+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:50.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:50.178+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:51.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:51.010+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:51.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:51.222+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:51.973 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:51.970+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:52.192 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:52.186+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:52.978 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:52.974+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:53.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:53.210+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:54.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:54.014+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:54.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:54.202+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:54.981 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:54.974+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:55.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:55.242+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:55.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:55.970+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:56.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:56.266+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:57.004 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:56.998+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:57.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:57.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:58.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:58.010+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:58.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:58.338+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:59.041 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:11:59.038+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:11:59.394 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:11:59.390+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:00.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:00.058+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:00.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:00.350+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:01.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:01.018+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:01.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:01.306+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:02.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:02.026+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:02.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:02.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:03.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:03.038+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:03.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:03.266+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:04.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:04.030+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:04.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:04.262+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:05.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:05.058+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:05.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:05.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:06.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:06.045+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:06.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:06.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:07.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:07.029+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:07.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:07.329+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:08.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:08.069+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:08.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:08.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:09.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:09.061+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:09.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:09.249+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:10.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:10.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:10.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:10.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:11.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:11.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:11.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:11.257+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:12.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:12.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:12.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:12.233+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:13.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:13.113+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:13.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:13.221+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:14.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:14.149+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:14.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:14.193+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:15.159 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:15.157+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:15.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:15.201+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:16.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:16.181+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:16.200 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:16.197+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:17.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:17.161+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:17.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:17.205+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:18.149 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:18.145+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:18.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:18.193+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:19.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:19.173+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:19.234 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:19.233+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:20.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:20.177+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:20.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:20.201+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:21.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:21.177+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:21.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:21.229+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:22.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:22.205+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:22.213 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:22.213+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:23.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:23.189+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:23.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:23.201+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:24.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:24.153+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:24.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:24.237+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:25.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:25.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:25.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:25.225+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:26.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:26.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:26.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:26.273+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:27.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:27.105+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:27.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:27.269+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:28.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:28.149+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:28.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:28.301+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:29.161 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:29.157+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:29.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:29.261+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:30.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:30.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:30.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:30.241+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:31.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:31.117+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:31.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:31.249+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:32.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:32.129+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:32.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:32.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:33.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:33.141+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:33.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:33.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:34.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:34.153+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:34.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:34.301+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:35.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:35.189+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:35.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:35.269+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:36.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:36.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:36.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:36.293+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:37.228 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:37.225+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:37.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:37.249+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:38.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:38.217+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:38.221 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:38.217+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:39.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:39.229+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:39.241 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:39.237+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:40.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:40.205+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:40.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:40.209+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:41.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:41.185+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:41.226 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:41.225+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:42.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:42.181+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:42.203 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:42.201+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:43.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:43.213+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:43.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:43.217+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:44.178 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:44.177+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:44.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:44.253+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:45.209 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:45.209+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:45.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:45.213+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:46.171 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:46.169+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:46.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:46.209+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:47.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:47.181+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:47.203 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:47.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:48.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:48.161+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:48.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:48.213+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:49.180 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:49.177+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:49.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:49.225+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:50.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:50.197+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:50.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:50.221+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:51.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:51.201+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:51.248 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:51.245+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:52.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:52.213+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:52.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:52.265+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:53.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:53.165+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:53.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:53.285+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:54.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:54.157+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:54.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:54.329+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:55.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:55.117+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:55.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:55.345+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:56.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:56.149+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:56.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:56.332+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:57.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:57.172+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:57.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:57.368+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:58.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:58.156+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:58.384 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:58.380+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:59.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:12:59.120+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:12:59.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:12:59.424+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:00.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:00.088+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:00.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:00.444+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:01.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:01.116+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:01.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:01.436+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:02.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:02.164+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:02.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:02.464+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:03.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:03.180+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:03.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:03.472+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:04.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:04.200+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:04.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:04.516+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:05.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:05.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:05.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:05.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:06.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:06.160+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:06.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:06.560+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:07.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:07.200+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:07.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:07.548+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:08.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:08.220+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:08.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:08.584+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:09.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:09.208+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:09.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:09.588+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:10.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:10.256+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:10.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:10.580+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:11.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:11.244+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:11.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:11.560+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:12.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:12.244+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:12.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:12.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:13.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:13.268+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:13.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:13.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:14.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:14.312+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:14.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:14.564+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:15.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:15.268+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:15.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:15.572+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:16.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:16.280+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:16.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:16.600+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:17.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:17.260+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:17.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:17.572+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:18.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:18.232+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:18.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:18.528+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:19.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:19.244+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:19.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:19.512+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:20.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:20.232+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:20.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:20.512+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:21.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:21.252+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:21.489 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:21.488+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:22.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:22.252+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:22.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:22.472+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:23.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:23.284+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:23.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:23.516+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:24.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:24.240+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:24.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:24.496+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:25.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:25.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:25.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:25.468+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:26.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:26.180+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:26.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:26.452+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:27.172 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:27.168+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:27.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:27.460+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:28.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:28.204+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:28.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:28.456+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:29.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:29.160+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:29.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:29.424+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:30.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:30.200+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:30.452 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:30.448+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:31.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:31.244+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:31.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:31.488+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:32.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:32.288+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:32.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:32.448+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:33.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:33.260+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:33.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:33.400+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:34.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:34.276+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:34.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:34.392+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:35.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:35.296+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:35.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:35.404+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:36.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:36.296+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:36.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:36.416+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:37.347 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:37.344+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:37.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:37.420+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:38.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:38.308+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:38.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:38.436+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:39.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:39.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:39.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:39.396+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:40.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:40.356+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:40.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:40.368+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:41.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:41.312+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:41.397 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:41.396+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:42.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:42.332+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:42.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:42.400+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:43.296 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:43.292+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:43.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:43.368+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:44.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:44.296+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:44.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:44.396+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:45.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:45.296+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:45.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:45.415+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:46.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:46.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:46.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:46.415+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:47.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:47.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:47.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:47.415+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:48.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:48.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:48.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:48.395+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:49.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:49.319+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:49.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:49.351+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:50.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:50.307+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:50.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:50.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:51.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:51.299+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:51.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:51.375+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:52.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:52.291+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:52.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:52.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:53.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:53.291+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:53.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:53.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:54.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:54.299+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:54.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:54.327+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:55.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:55.331+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:55.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:55.375+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:56.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:56.295+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:56.357 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:56.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:57.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:57.323+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:57.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:57.383+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:58.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:58.287+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:58.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:58.403+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:59.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:13:59.243+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:13:59.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:13:59.447+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:00.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:00.239+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:00.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:00.427+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:01.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:01.279+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:01.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:01.387+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:02.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:02.271+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:02.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:02.343+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:03.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:03.311+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:03.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:03.383+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:04.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:04.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:04.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:04.339+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:05.335 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:05.331+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:05.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:05.375+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:06.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:06.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:06.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:06.339+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:07.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:07.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:07.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:07.367+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:08.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:08.319+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:08.335 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:08.331+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:09.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:09.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:09.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:09.295+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:10.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:10.267+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:10.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:10.315+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:11.264 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:11.259+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:11.348 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:11.343+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:12.232 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:12.227+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:12.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:12.323+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:13.256 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:13.251+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:13.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:13.359+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:14.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:14.279+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:14.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:14.347+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:15.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:15.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:15.403 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:15.399+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:16.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:16.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:16.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:16.359+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:17.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:17.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:17.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:17.383+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:18.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:18.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:18.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:18.367+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:19.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:19.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:19.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:19.387+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:20.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:20.363+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:20.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:20.371+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:21.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:21.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:21.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:21.403+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:22.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:22.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:22.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:22.371+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:23.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:23.319+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:23.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:23.339+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:24.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:24.299+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:24.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:24.375+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:25.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:25.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:25.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:25.407+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:26.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:26.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:26.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:26.403+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:27.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:27.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:27.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:27.367+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:28.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:28.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:28.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:28.363+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:29.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:29.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:29.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:29.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:30.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:30.379+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:30.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:30.423+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:31.384 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:31.379+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:31.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:31.467+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:32.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:32.399+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:32.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:32.471+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:33.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:33.439+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:33.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:33.459+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:34.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:34.470+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:34.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:34.486+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:35.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:35.450+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:35.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:35.470+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:36.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:36.422+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:36.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:36.438+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:37.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:37.414+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:37.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:37.438+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:38.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:38.454+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:38.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:38.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:39.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:39.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:39.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:39.482+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:40.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:40.450+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:40.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:40.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:41.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:41.470+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:41.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:41.494+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:42.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:42.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:42.525 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:42.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:43.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:43.426+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:43.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:43.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:44.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:44.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:44.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:44.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:45.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:45.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:45.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:45.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:46.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:46.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:46.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:46.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:47.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:47.398+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:47.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:47.582+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:48.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:48.450+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:48.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:48.562+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:49.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:49.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:49.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:49.526+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:50.394 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:50.390+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:50.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:50.482+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:51.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:51.398+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:51.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:51.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:52.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:52.426+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:52.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:52.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:53.397 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:53.394+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:53.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:53.414+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:54.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:54.406+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:54.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:54.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:55.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:55.426+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:55.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:55.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:56.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:56.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:56.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:56.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:57.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:57.430+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:57.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:57.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:58.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:58.466+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:58.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:58.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:59.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:14:59.426+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:14:59.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:14:59.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:00.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:00.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:00.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:00.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:01.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:01.414+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:01.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:01.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:02.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:02.458+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:02.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:02.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:03.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:03.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:03.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:03.502+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:04.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:04.450+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:04.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:04.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:05.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:05.406+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:05.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:05.510+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:06.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:06.394+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:06.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:06.494+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:07.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:07.382+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:07.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:07.474+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:08.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:08.366+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:08.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:08.482+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:09.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:09.374+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:09.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:09.486+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:10.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:10.346+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:10.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:10.474+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:11.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:11.358+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:11.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:11.506+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:12.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:12.382+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:12.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:12.526+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:13.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:13.398+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:13.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:13.502+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:14.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:14.402+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:14.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:14.526+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:15.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:15.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:15.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:15.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:16.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:16.414+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:16.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:16.550+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:17.375 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:17.370+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:17.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:17.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:18.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:18.406+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:18.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:18.542+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:19.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:19.422+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:19.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:19.554+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:20.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:20.386+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:20.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:20.514+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:21.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:21.370+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:21.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:21.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:22.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:22.393+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:22.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:22.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:23.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:23.429+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:23.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:23.501+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:24.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:24.449+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:24.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:24.549+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:25.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:25.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:25.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:25.529+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:26.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:26.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:26.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:26.513+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:27.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:27.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:27.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:27.537+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:28.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:28.521+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:28.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:28.573+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:29.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:29.565+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:29.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:29.605+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:30.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:30.609+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:30.632 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:30.629+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:31.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:31.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:31.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:31.653+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:32.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:32.641+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:32.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:32.681+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:33.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:33.637+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:33.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:33.645+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:34.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:34.665+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:34.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:34.669+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:35.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:35.645+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:35.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:35.693+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:36.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:36.641+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:36.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:36.717+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:37.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:37.657+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:37.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:37.681+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:38.651 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:38.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:38.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:38.705+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:39.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:39.681+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:39.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:39.725+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:40.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:40.705+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:40.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:40.745+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:41.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:41.713+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:41.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:41.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:42.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:42.705+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:42.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:42.745+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:43.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:43.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:43.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:43.773+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:44.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:44.709+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:44.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:44.745+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:45.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:45.709+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:45.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:45.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:46.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:46.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:46.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:46.725+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:47.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:47.705+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:47.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:47.741+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:48.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:48.697+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:48.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:48.709+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:49.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:49.685+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:49.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:49.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:50.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:50.705+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:50.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:50.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:51.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:51.689+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:51.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:51.749+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:52.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:52.709+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:52.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:52.745+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:53.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:53.681+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:53.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:53.749+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:54.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:54.681+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:54.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:54.721+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:55.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:55.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:55.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:55.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:56.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:56.725+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:56.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:56.765+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:57.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:57.737+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:57.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:57.737+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:58.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:58.689+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:58.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:58.701+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:59.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:15:59.673+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:15:59.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:15:59.701+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:00.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:00.657+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:00.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:00.725+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:01.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:01.705+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:01.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:01.721+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:02.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:02.677+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:02.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:02.697+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:03.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:03.657+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:03.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:03.729+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:04.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:04.649+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:04.688 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:04.685+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:05.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:05.685+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:05.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:05.685+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:06.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:06.685+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:06.698 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:06.697+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:07.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:07.653+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:07.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:07.705+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:08.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:08.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:08.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:08.669+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:09.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:09.664+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:09.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:09.688+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:10.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:10.628+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:10.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:10.712+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:11.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:11.672+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:11.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:11.716+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:12.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:12.680+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:12.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:12.728+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:13.680 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:13.676+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:13.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:13.708+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:14.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:14.708+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:14.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:14.748+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:15.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:15.700+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:15.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:15.752+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:16.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:16.736+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:16.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:16.776+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:17.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:17.688+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:17.810 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:17.808+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:18.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:18.652+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:18.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:18.836+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:19.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:19.632+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:19.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:19.864+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:20.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:20.672+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:20.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:20.916+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:21.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:21.704+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:21.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:21.948+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:22.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:22.716+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:22.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:22.936+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:23.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:23.744+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:23.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:23.960+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:24.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:24.704+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:24.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:24.968+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:25.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:25.748+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:25.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:25.928+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:26.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:26.712+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:26.922 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:26.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:27.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:27.688+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:27.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:27.964+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:28.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:28.700+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:28.928 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:28.924+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:29.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:29.716+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:29.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:29.976+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:30.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:30.676+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:31.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:31.000+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:31.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:31.644+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:32.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:31.996+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:32.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:32.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:33.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:33.040+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:33.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:33.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:34.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:34.016+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:34.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:34.668+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:35.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:35.016+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:35.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:35.652+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:35.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:35.976+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:36.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:36.644+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:36.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:36.972+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:37.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:37.624+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:38.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:38.000+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:38.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:38.596+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:38.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:38.976+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:39.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:39.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:40.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:40.016+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:40.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:40.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:40.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:40.992+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:41.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:41.628+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:42.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:42.028+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:42.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:42.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:43.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:43.024+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:43.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:43.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:44.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:44.044+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:44.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:44.588+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:45.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:45.084+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:45.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:45.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:46.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:46.052+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:46.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:46.540+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:47.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:47.064+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:47.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:47.516+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:48.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:48.096+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:48.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:48.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:49.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:49.048+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:49.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:49.512+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:50.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:50.060+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:50.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:50.556+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:51.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:51.104+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:51.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:51.528+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:52.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:52.108+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:52.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:52.488+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:53.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:53.088+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:53.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:53.444+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:54.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:54.052+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:54.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:54.440+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:55.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:55.088+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:55.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:55.428+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:56.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:56.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:56.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:56.455+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:57.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:57.083+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:57.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:57.427+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:58.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:58.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:58.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:58.443+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:59.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:16:59.103+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:16:59.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:16:59.415+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:00.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:00.135+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:00.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:00.431+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:01.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:01.111+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:01.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:01.435+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:02.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:02.151+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:02.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:02.467+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:03.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:03.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:03.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:03.495+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:04.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:04.155+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:04.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:04.539+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:05.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:05.195+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:05.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:05.583+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:06.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:06.235+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:06.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:06.551+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:07.280 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:07.275+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:07.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:07.559+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:08.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:08.239+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:08.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:08.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:09.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:09.263+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:09.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:09.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:10.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:10.267+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:10.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:10.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:11.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:11.223+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:11.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:11.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:12.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:12.267+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:12.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:12.515+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:13.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:13.303+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:13.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:13.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:14.280 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:14.275+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:14.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:14.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:15.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:15.255+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:15.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:15.511+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:16.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:16.263+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:16.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:16.467+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:17.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:17.255+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:17.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:17.443+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:18.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:18.211+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:18.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:18.491+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:19.178 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:19.175+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:19.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:19.467+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:20.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:20.211+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:20.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:20.503+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:21.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:21.251+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:21.509 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:21.507+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:22.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:22.287+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:22.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:22.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:23.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:23.327+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:23.479 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:23.475+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:24.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:24.327+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:24.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:24.511+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:25.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:25.339+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:25.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:25.543+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:26.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:26.359+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:26.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:26.511+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:27.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:27.371+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:27.470 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:27.467+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:28.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:28.403+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:28.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:28.423+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:29.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:29.439+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:29.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:29.463+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:30.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:30.407+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:30.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:30.507+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:31.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:31.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:31.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:31.539+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:32.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:32.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:32.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:32.515+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:33.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:33.467+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:33.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:33.563+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:34.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:34.475+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:34.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:34.543+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:35.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:35.451+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:35.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:35.567+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:36.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:36.483+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:36.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:36.535+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:37.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:37.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:37.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:37.511+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:38.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:38.459+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:38.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:38.515+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:39.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:39.439+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:39.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:39.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:40.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:40.443+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:40.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:40.519+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:41.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:41.483+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:41.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:41.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:42.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:42.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:42.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:42.510+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:43.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:43.402+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:43.490 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:43.486+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:44.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:44.414+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:44.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:44.458+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:45.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:45.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:45.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:45.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:46.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:46.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:46.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:46.470+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:47.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:47.426+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:47.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:47.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:48.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:48.442+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:48.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:48.530+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:49.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:49.414+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:49.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:49.562+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:50.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:50.394+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:50.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:50.582+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:51.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:51.418+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:51.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:51.546+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:52.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:52.466+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:52.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:52.574+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:53.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:53.470+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:53.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:53.526+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:54.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:54.430+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:54.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:54.562+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:55.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:55.446+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:55.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:55.518+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:56.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:56.478+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:56.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:56.518+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:57.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:57.490+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:57.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:57.506+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:58.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:58.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:58.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:58.526+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:59.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:17:59.498+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:59.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:17:59.562+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:17:59.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T08:17:59.870+0000 7f3dd8a64700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ba0bb91e20 msgr2=0x55ba0bba2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T08:18:00.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:00.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:00.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:00.530+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:01.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:01.494+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:01.509 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:01.506+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:02.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:02.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:02.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:02.486+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:03.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:03.458+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:03.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:03.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:04.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:04.430+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:04.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:04.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:05.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:05.402+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:05.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:05.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:06.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:06.386+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:06.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:06.426+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:07.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:07.342+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:07.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:07.394+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:08.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:08.338+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:08.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:08.438+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:09.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:09.290+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:09.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:09.426+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:10.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:10.246+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:10.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:10.446+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:11.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:11.218+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:11.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:11.418+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:12.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:12.186+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:12.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:12.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:13.156 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:13.150+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:13.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:13.482+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:14.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:14.130+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:14.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:14.442+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:15.184 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:15.178+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:15.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:15.402+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:16.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:16.174+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:16.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:16.394+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:17.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:17.198+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:17.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:17.370+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:18.164 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:18.158+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:18.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:18.334+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:19.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:19.170+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:19.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:19.318+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:20.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:20.182+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:20.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:20.270+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:21.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:21.186+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:21.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:21.286+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:22.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:22.182+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:22.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:22.318+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:23.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:23.202+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:23.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:23.370+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:24.191 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:24.186+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:24.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:24.370+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:25.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:25.206+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:25.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:25.398+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:26.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:26.186+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:26.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:26.378+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:27.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:27.198+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:27.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:27.378+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:28.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:28.234+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:28.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:28.338+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:29.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:29.273+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:29.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:29.301+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:30.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:30.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:30.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:30.329+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:31.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:31.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:31.357 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:31.353+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:32.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:32.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:32.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:32.357+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:33.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:33.301+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:33.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:33.405+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:34.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:34.265+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:34.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:34.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:35.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:35.229+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:35.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:35.473+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:36.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:36.249+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:36.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:36.433+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:37.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:37.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:37.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:37.433+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:38.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:38.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:38.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:38.465+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:39.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:39.297+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:39.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:39.477+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:40.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:40.341+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:40.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:40.493+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:41.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:41.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:41.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:41.485+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:42.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:42.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:42.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:42.517+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:43.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:43.345+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:43.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:43.561+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:44.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:44.313+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:44.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:44.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:45.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:45.321+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:45.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:45.549+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:46.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:46.317+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:46.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:46.577+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:47.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:47.341+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:47.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:47.541+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:48.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:48.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:48.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:48.505+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:49.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:49.405+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:49.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:49.497+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:50.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:50.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:50.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:50.481+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:51.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:51.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:51.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:51.473+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:52.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:52.445+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:52.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:52.473+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:53.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:53.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:53.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:53.521+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:54.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:54.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:54.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:54.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:55.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:55.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:55.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:55.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:56.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:56.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:56.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:56.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:57.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:57.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:57.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:57.609+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:58.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:58.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:58.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:58.609+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:59.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:18:59.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:18:59.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:18:59.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:00.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:00.429+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:00.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:00.629+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:01.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:01.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:01.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:01.597+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:02.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:02.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:02.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:02.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:03.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:03.493+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:03.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:03.585+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:04.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:04.521+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:04.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:04.593+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:05.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:05.549+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:05.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:05.561+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:06.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:06.549+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:06.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:06.585+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:07.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:07.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:07.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:07.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:08.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:08.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:08.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:08.561+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:09.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:09.533+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:09.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:09.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:10.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:10.521+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:10.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:10.569+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:11.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:11.481+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:11.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:11.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:12.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:12.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:12.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:12.609+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:13.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:13.493+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:13.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:13.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:14.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:14.517+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:14.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:14.553+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:15.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:15.532+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:15.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:15.564+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:16.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:16.536+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:16.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:16.580+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:17.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:17.504+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:17.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:17.540+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:18.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:18.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:18.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:18.576+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:19.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:19.548+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:19.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:19.576+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:20.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:20.572+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:20.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:20.576+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:21.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:21.548+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:21.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:21.568+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:22.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:22.544+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:22.547 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:22.544+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:23.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:23.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:23.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:23.576+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:24.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:24.536+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:24.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:24.592+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:25.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:25.552+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:25.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:25.632+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:26.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:26.520+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:26.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:26.600+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:27.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:27.476+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:27.606 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:27.604+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:28.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:28.436+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:28.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:28.604+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:29.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:29.432+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:29.597 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:29.596+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:30.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:30.440+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:30.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:30.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:31.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:31.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:31.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:31.604+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:32.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:32.436+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:32.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:32.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:33.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:33.440+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:33.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:33.576+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:34.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:34.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:34.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:34.592+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:35.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:35.444+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:35.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:35.632+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:36.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:36.408+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:36.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:36.672+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:37.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:37.452+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:37.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:37.676+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:38.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:38.408+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:38.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:38.628+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:39.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:39.404+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:39.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:39.664+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:40.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:40.376+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:40.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:40.624+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:41.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:41.372+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:41.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:41.628+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:42.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:42.364+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:42.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:42.588+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:43.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:43.388+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:43.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:43.548+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:44.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:44.436+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:44.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:44.596+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:45.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:45.424+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:45.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:45.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:46.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:46.420+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:46.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:46.564+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:47.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:47.388+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:47.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:47.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:48.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:48.352+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:48.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:48.656+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:49.335 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:49.332+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:49.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:49.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:50.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:50.332+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:50.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:50.624+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:51.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:51.364+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:51.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:51.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:52.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:52.404+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:52.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:52.596+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:53.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:53.392+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:53.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:53.588+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:54.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:54.400+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:54.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:54.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:55.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:55.448+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:55.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:55.640+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:56.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:56.412+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:56.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:56.676+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:57.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:57.432+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:57.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:57.676+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:58.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:58.464+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:58.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:58.632+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:59.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:19:59.476+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:19:59.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:19:59.616+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:00.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:00.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:00.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:00.667+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:01.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:01.499+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:01.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:01.703+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:02.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:02.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:02.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:02.659+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:03.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:03.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:03.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:03.611+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:04.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:04.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:04.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:04.623+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:05.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:05.499+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:05.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:05.647+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:06.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:06.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:06.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:06.655+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:07.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:07.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:07.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:07.635+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:08.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:08.543+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:08.632 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:08.627+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:09.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:09.523+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:09.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:09.647+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:10.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:10.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:10.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:10.647+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:11.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:11.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:11.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:11.647+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:12.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:12.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:12.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:12.659+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:13.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:13.555+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:13.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:13.651+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:14.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:14.519+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:14.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:14.671+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:15.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:15.491+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:15.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:15.691+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:16.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:16.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:16.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:16.687+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:17.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:17.519+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:17.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:17.675+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:18.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:18.551+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:18.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:18.663+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:19.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:19.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:19.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:19.643+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:20.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:20.507+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:20.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:20.643+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:21.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:21.543+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:21.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:21.599+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:22.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:22.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:22.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:22.563+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:23.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:23.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:23.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:23.563+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:24.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:24.547+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:24.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:24.571+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:25.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:25.515+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:25.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:25.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:26.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:26.491+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:26.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:26.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:27.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:27.539+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:27.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:27.603+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:28.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:28.515+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:28.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:28.567+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:29.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:29.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:29.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:29.547+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:30.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:30.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:30.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:30.591+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:31.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:31.459+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:31.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:31.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:32.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:32.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:32.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:32.591+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:33.500 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:33.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:33.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:33.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:34.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:34.479+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:34.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:34.527+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:35.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:35.479+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:35.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:35.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:36.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:36.519+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:36.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:36.563+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:37.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:37.475+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:37.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:37.611+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:38.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:38.515+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:38.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:38.623+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:39.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:39.543+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:39.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:39.671+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:40.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:40.499+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:40.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:40.715+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:41.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:41.547+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:41.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:41.695+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:42.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:42.511+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:42.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:42.663+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:43.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:43.543+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:43.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:43.667+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:44.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:44.547+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:44.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:44.691+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:45.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:45.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:45.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:45.715+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:46.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:46.598+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:46.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:46.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:47.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:47.638+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:47.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:47.766+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:48.676 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:48.670+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:48.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:48.762+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:49.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:49.662+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:49.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:49.770+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:50.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:50.682+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:50.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:50.802+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:51.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:51.706+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:51.812 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:51.806+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:52.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:52.662+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:52.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:52.842+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:53.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:53.670+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:53.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:53.862+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:54.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:54.714+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:54.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:54.818+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:55.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:55.698+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:55.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:55.806+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:56.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:56.718+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:56.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:56.774+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:57.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:57.718+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:57.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:57.802+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:58.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:58.726+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:58.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:58.802+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:59.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:20:59.702+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:20:59.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:20:59.782+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:00.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:00.734+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:00.761 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:00.754+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:01.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:01.694+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:01.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:01.738+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:02.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:02.670+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:02.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:02.746+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:03.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:03.638+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:03.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:03.770+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:04.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:04.610+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:04.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:04.822+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:05.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:05.630+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:05.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:05.846+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:06.673 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:06.670+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:06.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:06.818+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:07.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:07.622+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:07.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:07.838+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:08.636 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:08.630+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:08.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:08.830+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:09.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:09.614+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:09.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:09.826+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:10.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:10.590+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:10.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:10.826+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:11.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:11.594+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:11.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:11.842+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:12.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:12.558+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:12.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:12.810+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:13.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:13.538+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:13.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:13.858+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:14.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:14.550+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:14.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:14.886+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:15.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:15.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:15.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:15.846+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:16.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:16.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:16.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:16.854+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:17.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:17.482+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:17.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:17.886+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:18.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:18.462+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:18.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:18.886+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:19.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:19.422+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:19.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:19.854+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:20.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:20.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:20.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:20.810+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:21.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:21.482+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:21.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:21.814+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:22.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:22.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:22.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:22.834+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:23.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:23.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:23.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:23.826+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:24.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:24.514+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:24.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:24.838+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:25.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:25.530+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:25.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:25.862+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:26.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:26.498+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:26.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:26.870+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:27.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:27.526+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:27.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:27.834+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:28.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:28.562+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:28.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:28.822+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:29.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:29.590+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:29.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:29.846+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:30.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:30.586+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:30.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:30.866+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:31.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:31.569+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:31.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:31.817+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:32.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:32.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:32.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:32.813+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:33.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:33.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:33.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:33.853+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:34.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:34.561+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:34.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:34.853+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:35.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:35.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:35.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:35.861+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:36.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:36.621+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:36.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:36.821+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:37.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:37.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:37.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:37.845+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:38.651 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:38.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:38.812 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:38.805+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:39.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:39.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:39.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:39.781+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:40.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:40.641+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:40.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:40.749+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:41.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:41.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:41.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:41.797+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:42.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:42.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:42.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:42.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:43.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:43.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:43.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:43.765+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:44.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:44.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:44.809 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:44.809+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:45.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:45.681+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:45.812 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:45.809+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:46.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:46.673+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:46.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:46.801+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:47.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:47.669+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:47.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:47.813+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:48.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:48.637+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:48.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:48.813+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:49.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:49.629+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:49.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:49.857+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:50.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:50.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:50.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:50.861+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:51.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:51.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:51.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:51.881+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:52.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:52.573+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:52.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:52.841+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:53.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:53.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:53.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:53.809+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:54.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:54.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:54.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:54.821+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:55.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:55.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:55.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:55.781+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:56.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:56.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:56.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:56.737+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:57.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:57.633+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:57.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:57.773+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:58.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:58.637+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:58.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:58.733+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:59.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:21:59.601+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:21:59.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:21:59.773+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:00.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:00.553+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:00.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:00.813+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:01.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:01.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:01.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:01.861+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:02.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:02.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:02.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:02.821+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:03.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:03.633+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:03.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:03.817+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:04.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:04.637+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:04.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:04.817+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:05.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:05.601+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:05.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:05.853+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:06.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:06.621+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:06.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:06.873+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:07.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:07.653+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:07.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:07.905+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:08.621 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:08.621+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:08.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:08.937+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:09.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:09.617+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:09.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:09.913+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:10.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:10.669+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:10.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:10.889+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:11.659 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:11.657+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:11.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:11.929+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:12.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:12.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:12.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:12.953+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:13.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:13.669+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:13.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:13.941+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:14.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:14.681+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:14.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:14.933+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:15.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:15.713+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:15.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:15.933+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:16.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:16.684+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:16.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:16.900+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:17.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:17.676+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:17.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:17.940+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:18.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:18.700+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:18.906 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:18.904+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:19.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:19.696+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:19.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:19.896+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:20.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:20.700+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:20.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:20.920+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:21.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:21.684+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:21.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:21.920+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:22.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:22.708+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:22.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:22.960+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:23.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:23.744+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:24.010 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:24.008+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:24.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:24.792+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:24.981 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:24.980+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:25.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:25.792+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:26.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:26.028+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:26.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:26.776+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:26.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:26.984+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:27.747 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:27.744+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:27.945 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:27.944+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:28.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:28.756+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:28.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:28.936+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:29.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:29.784+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:29.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:29.960+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:30.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:30.792+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:30.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:30.956+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:31.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:31.800+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:31.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:31.964+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:32.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:32.776+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:32.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:32.936+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:33.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:33.768+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:33.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:33.928+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:34.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:34.816+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:34.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:34.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:35.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:35.796+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:35.968 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:35.964+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:36.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:36.832+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:36.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:36.936+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:37.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:37.864+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:37.906 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:37.904+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:38.825 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:38.824+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:38.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:38.860+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:39.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:39.804+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:39.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:39.840+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:40.825 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:40.820+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:40.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:40.828+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:41.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:41.836+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:41.857 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:41.856+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:42.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:42.800+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:42.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:42.896+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:43.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:43.800+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:43.857 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:43.856+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:44.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:44.804+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:44.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:44.904+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:45.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:45.840+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:45.862 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:45.860+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:46.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:46.812+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:46.911 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:46.908+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:47.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:47.852+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:47.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:47.940+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:48.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:48.848+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:48.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:48.896+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:49.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:49.856+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:49.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:49.888+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:50.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:50.836+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:50.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:50.888+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:51.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:51.868+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:51.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:51.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:52.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:52.892+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:52.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:52.900+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:53.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:53.848+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:53.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:53.872+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:54.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:54.828+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:54.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:54.856+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:55.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:55.852+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:55.908 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:55.904+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:56.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:56.844+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:56.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:56.884+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:57.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:57.800+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:57.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:57.908+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:58.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:58.764+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:58.885 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:58.884+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:59.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:22:59.772+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:22:59.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:22:59.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:00.727 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:00.724+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:00.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:00.968+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:01.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:01.716+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:01.946 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:01.943+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:02.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:02.711+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:02.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:02.991+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:03.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:03.687+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:03.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:03.975+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:04.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:04.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:05.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:05.007+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:05.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:05.715+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:06.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:06.031+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:06.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:06.671+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:07.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:07.011+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:07.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:07.699+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:07.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:07.995+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:08.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:08.703+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:09.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:09.039+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:09.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:09.743+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:10.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:10.059+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:10.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:10.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:11.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:11.035+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:11.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:11.827+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:12.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:12.031+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:12.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:12.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:13.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:13.055+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:13.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:13.739+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:14.067 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:14.063+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:14.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:14.703+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:15.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:15.071+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:15.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:15.659+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:16.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:16.095+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:16.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:16.651+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:17.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:17.075+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:17.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:17.615+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:18.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:18.123+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:18.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:18.643+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:19.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:19.111+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:19.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:19.635+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:20.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:20.123+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:20.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:20.647+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:21.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:21.139+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:21.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:21.667+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:22.109 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:22.103+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:22.645 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:22.639+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:23.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:23.095+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:23.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:23.651+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:24.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:24.095+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:24.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:24.607+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:25.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:25.099+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:25.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:25.615+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:26.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:26.115+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:26.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:26.663+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:27.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:27.123+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:27.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:27.659+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:28.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:28.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:28.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:28.655+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:29.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:29.203+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:29.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:29.667+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:30.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:30.219+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:30.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:30.703+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:31.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:31.251+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:31.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:31.731+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:32.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:32.251+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:32.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:32.763+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:33.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:33.299+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:33.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:33.771+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:34.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:34.271+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:34.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:34.747+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:35.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:35.239+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:35.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:35.763+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:36.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:36.243+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:36.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:36.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:37.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:37.247+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:37.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:37.807+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:38.212 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:38.207+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:38.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:38.855+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:39.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:39.207+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:39.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:39.883+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:40.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:40.171+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:40.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:40.855+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:41.223 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:41.219+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:41.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:41.863+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:42.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:42.199+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:42.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:42.843+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:43.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:43.215+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:43.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:43.819+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:44.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:44.259+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:44.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:44.851+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:45.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:45.263+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:45.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:45.807+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:46.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:46.275+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:46.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:46.835+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:47.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:47.290+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:47.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:47.798+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:48.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:48.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:48.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:48.846+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:49.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:49.286+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:49.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:49.862+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:50.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:50.290+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:50.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:50.842+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:51.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:51.266+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:51.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:51.802+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:52.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:52.242+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:52.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:52.810+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:53.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:53.238+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:53.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:53.790+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:54.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:54.274+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:54.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:54.762+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:55.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:55.238+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:55.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:55.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:56.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:56.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:56.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:56.758+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:57.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:57.246+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:57.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:57.726+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:58.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:58.246+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:58.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:58.738+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:59.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:23:59.266+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:23:59.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:23:59.702+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:00.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:00.278+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:00.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:00.742+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:01.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:01.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:01.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:01.722+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:02.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:02.214+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:02.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:02.702+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:03.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:03.238+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:03.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:03.734+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:04.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:04.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:04.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:04.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:05.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:05.274+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:05.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:05.754+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:06.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:06.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:06.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:06.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:07.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:07.334+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:07.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:07.778+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:08.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:08.354+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:08.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:08.798+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:09.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:09.402+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:09.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:09.822+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:10.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:10.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:10.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:10.786+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:11.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:11.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:11.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:11.742+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:12.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:12.474+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:12.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:12.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:13.017 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T08:24:13.014+0000 7f3dd8a64700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:6800/21060,v1:172.21.15.184:6801/21060] conn(0x7f3db80344b0 msgr2=0x7f3db80413f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T08:24:13.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:13.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:13.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:13.726+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:14.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:14.462+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:14.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:14.766+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:15.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:15.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:15.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:15.754+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:16.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:16.398+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:16.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:16.798+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:17.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:17.354+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:17.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:17.818+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:18.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:18.322+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:18.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:18.842+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:19.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:19.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:19.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:19.882+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:20.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:20.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:20.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:20.858+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:21.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:21.286+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:21.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:21.866+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:22.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:22.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:22.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:22.890+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:23.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:23.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:23.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:23.938+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:24.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:24.338+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:24.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:24.898+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:25.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:25.354+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:25.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:25.946+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:26.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:26.346+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:26.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:26.970+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:27.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:27.314+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:27.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:27.954+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:28.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:28.326+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:28.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:28.954+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:29.375 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:29.370+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:29.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:29.970+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:30.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:30.334+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:30.955 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:30.950+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:31.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:31.350+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:32.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:31.998+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:32.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:32.345+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:33.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:33.025+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:33.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:33.385+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:34.013 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:34.009+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:34.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:34.425+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:35.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:35.001+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:35.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:35.385+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:35.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:35.961+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:36.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:36.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:37.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:37.001+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:37.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:37.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:38.015 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:38.013+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:38.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:38.405+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:38.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:38.989+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:39.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:39.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:40.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:40.013+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:40.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:40.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:40.995 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:40.993+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:41.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:41.517+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:42.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:42.025+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:42.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:42.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:43.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:43.033+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:43.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:43.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:44.017 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:44.013+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:44.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:44.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:44.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:44.977+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:45.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:45.529+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:45.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:45.941+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:46.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:46.481+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:46.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:46.913+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:47.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:47.513+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:47.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:47.877+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:48.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:48.509+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:48.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:48.849+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:49.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:49.481+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:49.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:49.897+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:50.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:50.449+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:50.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:50.893+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:51.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:51.497+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:51.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:51.929+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:52.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:52.497+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:52.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:52.961+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:53.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:53.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:53.977 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:53.977+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:54.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:54.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:55.020 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:55.017+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:55.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:55.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:55.989 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:55.985+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:56.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:56.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:57.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:57.037+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:57.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:57.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:58.016 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:58.013+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:58.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:58.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:59.006 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:24:59.005+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:24:59.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:24:59.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:00.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:00.001+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:00.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:00.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:00.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:00.985+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:01.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:01.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:01.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:01.993+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:02.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:02.461+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:03.007 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:03.005+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:03.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:03.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:04.041 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:04.037+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:04.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:04.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:04.993 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:04.993+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:05.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:05.517+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:05.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:05.949+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:06.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:06.529+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:06.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:06.921+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:07.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:07.577+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:07.939 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:07.937+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:08.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:08.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:08.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:08.949+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:09.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:09.565+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:09.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:09.969+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:10.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:10.609+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:10.977 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:10.977+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:11.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:11.617+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:11.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:11.949+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:12.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:12.657+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:12.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:12.901+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:13.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:13.701+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:13.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:13.857+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:14.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:14.733+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:14.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:14.905+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:15.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:15.709+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:15.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:15.873+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:16.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:16.757+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:16.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:16.865+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:17.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:17.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:17.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:17.816+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:18.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:18.704+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:18.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:18.864+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:19.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:19.720+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:19.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:19.832+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:20.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:20.720+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:20.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:20.816+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:21.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:21.688+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:21.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:21.792+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:22.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:22.712+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:22.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:22.788+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:23.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:23.756+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:23.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:23.776+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:24.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:24.752+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:24.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:24.816+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:25.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:25.796+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:25.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:25.816+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:26.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:26.816+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:26.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:26.820+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:27.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:27.828+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:27.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:27.848+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:28.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:28.864+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:28.881 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:28.876+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:29.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:29.868+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:29.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:29.900+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:30.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:30.828+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:30.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:30.940+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:31.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:31.792+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:31.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:31.936+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:32.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:32.772+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:32.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:32.916+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:33.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:33.792+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:33.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:33.888+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:34.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:34.772+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:34.927 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:34.924+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:35.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:35.796+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:35.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:35.904+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:36.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:36.832+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:36.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:36.892+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:37.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:37.804+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:37.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:37.904+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:38.848 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:38.844+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:38.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:38.948+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:39.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:39.848+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:39.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:39.936+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:40.886 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:40.884+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:40.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:40.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:41.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:41.892+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:41.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:41.904+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:42.927 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:42.924+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:42.946 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:42.944+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:43.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:43.896+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:43.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:43.912+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:44.918 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:44.916+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:44.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:44.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:45.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:45.900+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:45.969 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:45.968+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:46.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:46.872+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:47.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:47.000+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:47.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:47.868+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:48.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:48.012+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:48.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:48.912+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:49.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:49.040+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:49.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:49.868+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:50.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:50.052+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:50.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:50.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:51.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:51.056+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:51.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:51.924+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:52.022 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:52.020+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:52.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:52.912+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:53.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:53.068+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:53.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:53.956+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:54.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:54.112+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:55.001 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:54.996+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:55.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:55.108+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:56.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:56.032+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:56.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:56.132+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:57.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:57.076+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:57.104 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:57.100+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:58.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:58.080+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:58.123 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:58.120+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:59.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:25:59.124+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:25:59.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:25:59.168+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:00.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:00.156+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:00.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:00.168+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:01.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:01.140+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:01.209 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:01.208+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:02.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:02.151+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:02.213 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:02.207+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:03.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:03.147+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:03.218 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:03.215+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:04.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:04.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:04.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:04.207+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:05.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:05.083+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:05.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:05.171+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:06.133 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:06.131+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:06.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:06.147+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:07.102 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:07.099+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:07.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:07.155+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:08.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:08.143+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:08.203 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:08.199+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:09.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:09.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:09.201 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:09.199+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:10.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:10.155+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:10.196 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:10.191+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:11.138 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:11.135+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:11.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:11.163+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:12.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:12.111+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:12.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:12.155+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:13.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:13.115+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:13.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:13.179+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:14.138 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:14.135+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:14.161 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:14.159+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:15.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:15.115+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:15.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:15.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:16.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:16.079+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:16.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:16.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:17.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:17.083+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:17.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:17.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:18.082 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:18.079+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:18.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:18.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:19.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:19.063+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:19.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:19.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:20.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:20.103+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:20.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:20.135+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:21.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:21.119+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:21.191 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:21.187+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:22.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:22.091+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:22.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:22.155+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:23.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:23.071+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:23.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:23.183+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:24.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:24.075+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:24.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:24.235+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:25.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:25.103+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:25.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:25.263+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:26.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:26.071+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:26.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:26.291+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:27.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:27.103+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:27.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:27.307+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:28.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:28.063+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:28.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:28.311+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:29.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:29.087+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:29.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:29.311+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:30.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:30.071+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:30.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:30.287+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:31.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:31.043+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:31.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:31.331+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:32.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:32.011+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:32.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:32.375+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:32.973 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:32.971+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:33.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:33.403+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:33.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:33.927+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:34.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:34.383+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:34.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:34.911+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:35.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:35.419+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:35.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:35.939+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:36.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:36.431+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:36.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:36.927+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:37.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:37.459+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:37.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:37.887+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:38.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:38.487+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:38.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:38.895+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:39.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:39.519+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:39.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:39.867+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:40.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:40.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:40.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:40.843+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:41.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:41.603+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:41.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:41.799+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:42.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:42.631+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:42.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:42.759+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:43.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:43.631+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:43.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:43.739+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:44.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:44.671+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:44.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:44.731+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:45.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:45.683+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:45.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:45.715+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:46.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:46.695+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:46.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:46.715+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:47.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:47.682+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:47.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:47.682+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:48.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:48.666+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:48.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:48.682+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:49.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:49.674+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:49.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:49.682+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:50.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:50.638+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:50.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:50.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:51.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:51.650+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:51.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:51.742+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:52.636 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:52.630+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:52.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:52.726+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:53.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:53.582+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:53.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:53.706+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:54.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:54.626+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:54.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:54.710+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:55.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:55.594+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:55.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:55.686+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:56.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:56.550+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:56.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:56.670+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:57.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:57.518+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:57.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:57.706+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:58.146 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T08:26:58.142+0000 7f3dd9265700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x55ba0bbf7e90 msgr2=0x7f3db80e6890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T08:26:58.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:58.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:58.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:58.658+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:59.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:26:59.498+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:26:59.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:26:59.702+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:00.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:00.498+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:00.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:00.690+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:01.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:01.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:01.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:01.678+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:02.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:02.518+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:02.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:02.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:03.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:03.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:03.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:03.730+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:04.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:04.566+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:04.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:04.698+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:05.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:05.562+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:05.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:05.742+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:06.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:06.538+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:06.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:06.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:07.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:07.562+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:07.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:07.734+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:08.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:08.538+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:08.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:08.690+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:09.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:09.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:09.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:09.738+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:10.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:10.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:10.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:10.702+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:11.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:11.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:11.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:11.658+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:12.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:12.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:12.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:12.642+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:13.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:13.486+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:13.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:13.634+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:14.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:14.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:14.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:14.654+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:15.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:15.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:15.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:15.654+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:16.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:16.426+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:16.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:16.686+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:17.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:17.414+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:17.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:17.670+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:18.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:18.382+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:18.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:18.658+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:19.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:19.402+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:19.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:19.690+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:20.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:20.390+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:20.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:20.710+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:21.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:21.414+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:21.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:21.730+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:22.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:22.386+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:22.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:22.698+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:23.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:23.374+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:23.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:23.730+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:24.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:24.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:24.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:24.730+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:25.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:25.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:25.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:25.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:26.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:26.366+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:26.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:26.782+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:27.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:27.322+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:27.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:27.826+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:28.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:28.334+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:28.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:28.818+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:29.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:29.386+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:29.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:29.862+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:30.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:30.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:30.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:30.858+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:31.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:31.370+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:31.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:31.890+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:32.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:32.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:32.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:32.865+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:33.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:33.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:33.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:33.849+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:34.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:34.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:34.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:34.897+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:35.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:35.493+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:35.919 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:35.913+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:36.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:36.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:36.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:36.921+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:37.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:37.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:37.971 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:37.969+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:38.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:38.481+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:39.004 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:39.001+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:39.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:39.521+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:39.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:39.957+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:40.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:40.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:40.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:40.933+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:41.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:41.497+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:41.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:41.933+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:42.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:42.461+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:42.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:42.977+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:43.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:43.429+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:43.988 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:43.985+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:44.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:44.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:44.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:44.941+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:45.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:45.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:45.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:45.981+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:46.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:46.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:46.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:46.989+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:47.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:47.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:47.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:47.957+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:48.403 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:48.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:48.985 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:48.981+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:49.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:49.369+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:49.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:49.957+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:50.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:50.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:50.968 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:50.965+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:51.325 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:51.325+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:51.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:51.965+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:52.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:52.365+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:52.989 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:52.989+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:53.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:53.321+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:53.946 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:53.945+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:54.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:54.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:54.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:54.985+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:55.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:55.309+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:55.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:55.957+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:56.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:56.337+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:56.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:56.965+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:57.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:57.309+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:57.964 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:57.961+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:58.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:58.353+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:58.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:58.937+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:59.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:27:59.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:27:59.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:27:59.961+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:00.335 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:00.333+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:00.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:00.961+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:01.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:01.305+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:01.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:01.949+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:02.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:02.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:02.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:02.921+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:03.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:03.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:03.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:03.905+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:04.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:04.257+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:04.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:04.929+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:05.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:05.297+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:05.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:05.949+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:06.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:06.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:06.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:06.929+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:07.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:07.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:07.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:07.901+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:08.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:08.269+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:08.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:08.861+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:09.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:09.225+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:09.868 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:09.865+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:10.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:10.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:10.918 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:10.917+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:11.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:11.265+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:11.939 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:11.937+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:12.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:12.313+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:12.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:12.933+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:13.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:13.281+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:13.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:13.921+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:14.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:14.261+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:14.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:14.885+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:15.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:15.281+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:15.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:15.873+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:16.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:16.325+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:16.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:16.908+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:17.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:17.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:17.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:17.880+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:18.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:18.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:18.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:18.836+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:19.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:19.332+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:19.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:19.840+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:20.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:20.352+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:20.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:20.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:21.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:21.312+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:21.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:21.932+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:22.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:22.288+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:22.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:22.976+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:23.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:23.268+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:23.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:23.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:24.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:24.300+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:24.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:24.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:25.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:25.332+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:26.004 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:26.000+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:26.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:26.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:27.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:27.052+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:27.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:27.376+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:28.041 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:28.036+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:28.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:28.360+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:29.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:29.048+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:29.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:29.356+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:30.017 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:30.016+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:30.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:30.368+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:31.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:31.028+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:31.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:31.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:32.047 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:32.044+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:32.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:32.336+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:33.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:33.092+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:33.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:33.360+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:34.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:34.056+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:34.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:34.352+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:35.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:35.096+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:35.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:35.304+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:36.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:36.096+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:36.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:36.268+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:37.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:37.088+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:37.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:37.240+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:38.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:38.128+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:38.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:38.220+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:39.085 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:39.084+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:39.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:39.204+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:40.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:40.096+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:40.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:40.208+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:41.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:41.068+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:41.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:41.172+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:42.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:42.116+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:42.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:42.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:43.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:43.112+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:43.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:43.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:44.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:44.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:44.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:44.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:45.162 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:45.160+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:45.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:45.172+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:46.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:46.116+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:46.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:46.208+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:47.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:47.076+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:47.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:47.200+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:48.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:48.064+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:48.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:48.184+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:49.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:49.020+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:49.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:49.140+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:50.061 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:50.060+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:50.173 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:50.168+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:51.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:51.024+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:51.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:51.156+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:52.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:52.068+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:52.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:52.112+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:53.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:53.080+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:53.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:53.084+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:54.067 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:54.064+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:54.133 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:54.132+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:55.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:55.040+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:55.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:55.100+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:56.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:56.032+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:56.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:56.132+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:57.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:57.032+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:57.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:57.124+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:58.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:58.020+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:58.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:58.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:59.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:28:59.068+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:28:59.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:28:59.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:00.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:00.080+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:00.200 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:00.196+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:01.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:01.048+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:01.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:01.240+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:02.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:01.999+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:02.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:02.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:03.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:03.047+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:03.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:03.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:04.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:04.095+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:04.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:04.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:05.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:05.099+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:05.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:05.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:06.133 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:06.127+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:06.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:06.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:07.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:07.171+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:07.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:07.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:08.155 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:08.151+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:08.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:08.415+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:09.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:09.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:09.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:09.443+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:10.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:10.191+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:10.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:10.431+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:11.172 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:11.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:11.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:11.439+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:12.164 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:12.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:12.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:12.423+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:13.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:13.147+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:13.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:13.451+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:14.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:14.199+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:14.504 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:14.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:15.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:15.207+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:15.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:15.527+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:16.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:16.211+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:16.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:16.511+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:17.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:17.227+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:17.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:17.543+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:18.219 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:18.215+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:18.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:18.543+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:19.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:19.203+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:19.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:19.519+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:20.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:20.235+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:20.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:20.479+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:21.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:21.263+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:21.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:21.527+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:22.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:22.231+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:22.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:22.543+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:23.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:23.203+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:23.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:23.551+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:24.231 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:24.227+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:24.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:24.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:25.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:25.207+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:25.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:25.591+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:26.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:26.223+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:26.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:26.583+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:27.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:27.227+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:27.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:27.567+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:28.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:28.199+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:28.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:28.559+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:29.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:29.199+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:29.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:29.583+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:30.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:30.211+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:30.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:30.535+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:31.203 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:31.199+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:31.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:31.559+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:32.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:32.231+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:32.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:32.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:33.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:33.267+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:33.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:33.603+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:34.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:34.315+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:34.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:34.611+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:35.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:35.347+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:35.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:35.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:36.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:36.375+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:36.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:36.623+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:37.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:37.335+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:37.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:37.595+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:38.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:38.319+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:38.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:38.551+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:39.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:39.347+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:39.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:39.539+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:40.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:40.379+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:40.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:40.503+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:41.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:41.379+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:41.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:41.551+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:42.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:42.415+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:42.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:42.563+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:43.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:43.455+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:43.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:43.579+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:44.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:44.431+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:44.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:44.583+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:45.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:45.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:45.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:45.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:46.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:46.399+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:46.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:46.594+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:47.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:47.402+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:47.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:47.618+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:48.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:48.430+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:48.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:48.638+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:49.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:49.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:49.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:49.682+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:50.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:50.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:50.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:50.702+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:51.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:51.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:51.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:51.730+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:52.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:52.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:52.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:52.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:53.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:53.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:53.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:53.794+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:54.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:54.430+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:54.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:54.790+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:55.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:55.450+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:55.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:55.818+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:56.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:56.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:56.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:56.854+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:57.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:57.430+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:57.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:57.898+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:58.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:58.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:58.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:58.850+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:59.480 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:29:59.474+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:29:59.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:29:59.866+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:00.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:00.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:00.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:00.850+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:01.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:01.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:01.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:01.850+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:02.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:02.450+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:02.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:02.878+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:03.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:03.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:03.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:03.854+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:04.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:04.422+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:04.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:04.838+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:05.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:05.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:05.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:05.878+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:06.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:06.470+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:06.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:06.882+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:07.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:07.462+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:07.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:07.890+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:08.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:08.470+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:08.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:08.906+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:09.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:09.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:09.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:09.874+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:10.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:10.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:10.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:10.866+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:11.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:11.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:11.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:11.890+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:12.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:12.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:12.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:12.910+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:13.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:13.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:13.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:13.930+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:14.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:14.430+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:14.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:14.962+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:15.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:15.406+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:15.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:15.934+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:16.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:16.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:16.968 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:16.962+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:17.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:17.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:17.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:17.990+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:18.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:18.426+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:18.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:18.982+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:19.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:19.426+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:20.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:20.034+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:20.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:20.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:21.084 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:21.078+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:21.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:21.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:22.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:22.066+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:22.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:22.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:23.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:23.106+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:23.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:23.366+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:24.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:24.070+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:24.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:24.338+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:25.041 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:25.038+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:25.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:25.318+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:26.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:26.082+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:26.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:26.346+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:27.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:27.082+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:27.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:27.314+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:28.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:28.062+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:28.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:28.326+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:29.047 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:29.042+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:29.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:29.310+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:30.064 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:30.058+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:30.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:30.282+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:31.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:31.106+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:31.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:31.301+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:32.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:32.145+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:32.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:32.345+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:33.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:33.173+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:33.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:33.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:34.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:34.169+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:34.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:34.309+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:35.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:35.165+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:35.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:35.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:36.132 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:36.125+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:36.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:36.381+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:37.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:37.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:37.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:37.369+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:38.099 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:38.097+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:38.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:38.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:39.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:39.069+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:39.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:39.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:40.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:40.113+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:40.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:40.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:41.153 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:41.149+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:41.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:41.405+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:42.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:42.185+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:42.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:42.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:43.161 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:43.161+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:43.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:43.329+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:44.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:44.205+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:44.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:44.297+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:45.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:45.185+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:45.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:45.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:46.209 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:46.205+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:46.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:46.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:47.167 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:47.165+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:47.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:47.249+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:48.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:48.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:48.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:48.281+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:49.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:49.173+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:49.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:49.245+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:50.133 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:50.133+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:50.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:50.293+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:51.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:51.117+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:51.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:51.329+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:52.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:52.101+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:52.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:52.313+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:53.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:53.105+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:53.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:53.317+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:54.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:54.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:54.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:54.341+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:55.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:55.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:55.294 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:55.293+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:56.132 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:56.129+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:56.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:56.333+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:57.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:57.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:57.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:57.329+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:58.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:58.085+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:58.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:58.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:59.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:30:59.077+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:30:59.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:30:59.385+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:00.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:00.085+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:00.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:00.345+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:01.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:01.037+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:01.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:01.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:02.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:02.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:02.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:02.389+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:03.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:03.073+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:03.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:03.425+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:04.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:04.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:04.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:04.385+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:05.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:05.125+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:05.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:05.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:06.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:06.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:06.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:06.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:07.085 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:07.081+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:07.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:07.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:08.091 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:08.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:08.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:08.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:09.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:09.077+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:09.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:09.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:10.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:10.073+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:10.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:10.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:11.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:11.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:11.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:11.465+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:12.085 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:12.081+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:12.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:12.481+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:13.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:13.065+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:13.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:13.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:14.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:14.117+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:14.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:14.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:15.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:15.149+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:15.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:15.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:16.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:16.117+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:16.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:16.468+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:17.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:17.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:17.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:17.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:18.178 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:18.176+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:18.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:18.472+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:19.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:19.208+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:19.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:19.464+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:20.192 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:20.188+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:20.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:20.480+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:21.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:21.196+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:21.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:21.444+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:22.201 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:22.196+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:22.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:22.460+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:23.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:23.248+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:23.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:23.472+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:24.224 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:24.220+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:24.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:24.456+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:25.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:25.260+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:25.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:25.448+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:26.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:26.276+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:26.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:26.460+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:27.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:27.252+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:27.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:27.504+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:28.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:28.244+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:28.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:28.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:29.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:29.284+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:29.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:29.460+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:30.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:30.288+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:30.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:30.448+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:31.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:31.248+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:31.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:31.416+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:32.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:32.220+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:32.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:32.412+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:33.263 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:33.260+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:33.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:33.456+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:34.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:34.228+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:34.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:34.464+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:35.208 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:35.204+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:35.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:35.456+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:36.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:36.172+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:36.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:36.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:37.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:37.172+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:37.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:37.480+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:38.190 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:38.188+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:38.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:38.504+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:39.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:39.156+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:39.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:39.480+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:40.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:40.144+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:40.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:40.520+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:41.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:41.152+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:41.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:41.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:42.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:42.116+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:42.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:42.500+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:43.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:43.076+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:43.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:43.512+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:44.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:44.104+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:44.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:44.536+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:45.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:45.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:45.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:45.536+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:46.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:46.180+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:46.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:46.584+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:47.210 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:47.208+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:47.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:47.576+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:48.226 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:48.224+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:48.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:48.540+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:49.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:49.224+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:49.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:49.540+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:50.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:50.264+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:50.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:50.552+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:51.220 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:51.216+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:51.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:51.528+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:52.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:52.180+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:52.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:52.516+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:53.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:53.144+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:53.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:53.512+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:54.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:54.104+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:54.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:54.504+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:55.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:55.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:55.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:55.464+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:56.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:56.128+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:56.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:56.440+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:57.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:57.080+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:57.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:57.432+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:58.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:58.048+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:58.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:58.420+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:59.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:31:59.092+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:31:59.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:31:59.456+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:00.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:00.076+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:00.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:00.472+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:01.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:01.116+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:01.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:01.428+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:02.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:02.123+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:02.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:02.423+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:03.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:03.171+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:03.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:03.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:04.193 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:04.191+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:04.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:04.459+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:05.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:05.223+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:05.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:05.495+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:06.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:06.207+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:06.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:06.459+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:07.242 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:07.239+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:07.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:07.443+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:08.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:08.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:08.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:08.463+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:09.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:09.267+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:09.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:09.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:10.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:10.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:10.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:10.483+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:11.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:11.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:11.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:11.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:12.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:12.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:12.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:12.543+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:13.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:13.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:13.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:13.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:14.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:14.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:14.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:14.551+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:15.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:15.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:15.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:15.591+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:16.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:16.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:16.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:16.547+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:17.327 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:17.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:17.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:17.567+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:18.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:18.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:18.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:18.591+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:19.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:19.343+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:19.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:19.587+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:20.309 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:20.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:20.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:20.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:21.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:21.327+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:21.589 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:21.583+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:22.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:22.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:22.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:22.571+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:23.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:23.331+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:23.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:23.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:24.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:24.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:24.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:24.535+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:25.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:25.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:25.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:25.563+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:26.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:26.267+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:26.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:26.583+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:27.267 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:27.263+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:27.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:27.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:28.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:28.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:28.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:28.571+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:29.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:29.311+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:29.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:29.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:30.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:30.283+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:30.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:30.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:31.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:31.251+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:31.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:31.515+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:32.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:32.251+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:32.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:32.515+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:33.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:33.271+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:33.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:33.543+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:34.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:34.271+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:34.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:34.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:35.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:35.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:35.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:35.499+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:36.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:36.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:36.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:36.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:37.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:37.311+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:37.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:37.467+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:38.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:38.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:38.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:38.467+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:39.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:39.391+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:39.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:39.523+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:40.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:40.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:40.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:40.479+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:41.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:41.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:41.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:41.435+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:42.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:42.311+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:42.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:42.467+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:43.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:43.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:43.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:43.451+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:44.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:44.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:44.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:44.499+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:45.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:45.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:45.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:45.531+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:46.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:46.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:46.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:46.567+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:47.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:47.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:47.583 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:47.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:48.327 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:48.322+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:48.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:48.546+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:49.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:49.318+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:49.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:49.594+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:50.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:50.342+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:50.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:50.622+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:51.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:51.322+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:51.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:51.614+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:52.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:52.362+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:52.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:52.586+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:53.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:53.390+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:53.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:53.618+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:54.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:54.422+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:54.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:54.602+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:55.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:55.474+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:55.621 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:55.614+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:56.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:56.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:56.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:56.574+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:57.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:57.530+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:57.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:57.562+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:58.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:58.506+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:58.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:58.522+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:59.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:32:59.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:32:59.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:32:59.514+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:00.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:00.530+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:00.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:00.554+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:01.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:01.518+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:01.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:01.570+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:02.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:02.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:02.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:02.598+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:03.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:03.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:03.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:03.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:04.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:04.534+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:04.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:04.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:05.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:05.534+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:05.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:05.542+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:06.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:06.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:06.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:06.578+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:07.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:07.522+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:07.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:07.546+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:08.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:08.514+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:08.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:08.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:09.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:09.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:09.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:09.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:10.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:10.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:10.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:10.554+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:11.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:11.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:11.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:11.598+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:12.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:12.506+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:12.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:12.574+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:13.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:13.462+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:13.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:13.558+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:14.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:14.482+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:14.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:14.522+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:15.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:15.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:15.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:15.542+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:16.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:16.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:16.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:16.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:17.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:17.394+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:17.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:17.550+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:18.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:18.370+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:18.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:18.578+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:19.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:19.382+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:19.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:19.562+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:20.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:20.334+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:20.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:20.554+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:21.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:21.366+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:21.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:21.526+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:22.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:22.366+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:22.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:22.570+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:23.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:23.330+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:23.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:23.614+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:24.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:24.286+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:24.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:24.574+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:25.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:25.238+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:25.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:25.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:26.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:26.246+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:26.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:26.494+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:27.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:27.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:27.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:27.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:28.335 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:28.330+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:28.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:28.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:29.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:29.374+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:29.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:29.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:30.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:30.362+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:30.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:30.570+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:31.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:31.386+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:31.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:31.618+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:32.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:32.338+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:32.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:32.618+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:33.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:33.314+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:33.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:33.574+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:34.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:34.361+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:34.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:34.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:35.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:35.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:35.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:35.517+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:36.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:36.333+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:36.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:36.525+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:37.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:37.369+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:37.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:37.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:38.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:38.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:38.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:38.553+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:39.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:39.449+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:39.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:39.533+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:40.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:40.429+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:40.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:40.489+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:41.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:41.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:41.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:41.473+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:42.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:42.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:42.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:42.445+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:43.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:43.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:43.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:43.473+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:44.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:44.489+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:44.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:44.493+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:45.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:45.461+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:45.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:45.529+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:46.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:46.433+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:46.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:46.557+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:47.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:47.413+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:47.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:47.581+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:48.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:48.425+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:48.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:48.613+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:49.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:49.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:49.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:49.653+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:50.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:50.441+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:50.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:50.637+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:51.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:51.437+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:51.677 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:51.673+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:52.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:52.453+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:52.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:52.717+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:53.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:53.493+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:53.715 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:53.713+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:54.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:54.529+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:54.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:54.721+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:55.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:55.497+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:55.768 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:55.765+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:56.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:56.497+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:56.780 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:56.777+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:57.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:57.525+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:57.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:57.757+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:58.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:58.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:58.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:58.753+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:59.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:33:59.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:33:59.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:33:59.725+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:00.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:00.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:00.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:00.681+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:01.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:01.601+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:01.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:01.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:02.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:02.593+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:02.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:02.621+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:03.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:03.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:03.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:03.613+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:04.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:04.525+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:04.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:04.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:05.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:05.537+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:05.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:05.577+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:06.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:06.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:06.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:06.581+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:07.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:07.549+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:07.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:07.585+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:08.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:08.521+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:08.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:08.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:09.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:09.477+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:09.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:09.609+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:10.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:10.509+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:10.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:10.609+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:11.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:11.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:11.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:11.601+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:12.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:12.573+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:12.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:12.577+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:13.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:13.573+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:13.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:13.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:14.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:14.553+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:14.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:14.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:15.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:15.537+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:15.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:15.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:16.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:16.513+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:16.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:16.573+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:17.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:17.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:17.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:17.565+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:18.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:18.521+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:18.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:18.573+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:19.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:19.493+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:19.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:19.589+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:20.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:20.529+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:20.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:20.629+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:21.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:21.508+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:21.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:21.660+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:22.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:22.464+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:22.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:22.640+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:23.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:23.504+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:23.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:23.624+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:24.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:24.528+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:24.621 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:24.620+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:25.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:25.480+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:25.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:25.620+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:26.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:26.532+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:26.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:26.644+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:27.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:27.508+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:27.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:27.624+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:28.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:28.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:28.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:28.644+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:29.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:29.528+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:29.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:29.660+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:30.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:30.496+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:30.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:30.660+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:31.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:31.544+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:31.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:31.708+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:32.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:32.504+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:32.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:32.700+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:33.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:33.544+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:33.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:33.720+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:34.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:34.596+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:34.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:34.768+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:35.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:35.636+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:35.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:35.748+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:36.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:36.600+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:36.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:36.704+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:37.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:37.572+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:37.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:37.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:38.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:38.560+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:38.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:38.672+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:39.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:39.592+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:39.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:39.632+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:40.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:40.560+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:40.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:40.628+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:41.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:41.556+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:41.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:41.664+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:42.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:42.588+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:42.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:42.676+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:43.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:43.624+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:43.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:43.720+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:44.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:44.624+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:44.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:44.764+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:45.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:45.640+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:45.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:45.732+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:46.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:46.632+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:46.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:46.772+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:47.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:47.648+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:47.817 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:47.812+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:48.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:48.600+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:48.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:48.864+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:49.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:49.592+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:49.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:49.884+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:50.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:50.556+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:50.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:50.844+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:51.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:51.536+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:51.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:51.804+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:52.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:52.552+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:52.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:52.812+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:53.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:53.532+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:53.834 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:53.832+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:54.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:54.512+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:54.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:54.788+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:55.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:55.512+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:55.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:55.748+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:56.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:56.548+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:56.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:56.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:57.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:57.532+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:57.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:57.752+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:58.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:58.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:58.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:58.712+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:59.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:34:59.608+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:34:59.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:34:59.744+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:00.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:00.584+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:00.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:00.732+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:01.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:01.600+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:01.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:01.776+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:02.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:02.620+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:02.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:02.804+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:03.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:03.600+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:03.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:03.848+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:04.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:04.600+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:04.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:04.892+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:05.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:05.568+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:05.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:05.936+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:06.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:06.560+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:06.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:06.896+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:07.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:07.604+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:07.904 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:07.899+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:08.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:08.619+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:08.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:08.927+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:09.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:09.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:09.892 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:09.887+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:10.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:10.607+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:10.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:10.851+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:11.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:11.587+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:11.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:11.899+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:12.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:12.579+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:12.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:12.935+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:13.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:13.563+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:13.905 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:13.903+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:14.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:14.531+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:14.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:14.931+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:15.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:15.523+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:15.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:15.979+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:16.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:16.495+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:16.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:16.947+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:17.509 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:17.507+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:17.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:17.943+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:18.480 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:18.475+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:18.908 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:18.903+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:19.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:19.503+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:19.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:19.947+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:20.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:20.459+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:20.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:20.947+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:21.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:21.431+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:21.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:21.927+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:22.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:22.451+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:22.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:22.971+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:23.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:23.439+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:24.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:23.999+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:24.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:24.451+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:25.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:25.007+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:25.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:25.435+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:26.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:26.027+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:26.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:26.435+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:26.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:26.995+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:27.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:27.467+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:28.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:28.043+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:28.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:28.423+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:29.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:29.007+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:29.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:29.395+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:29.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:29.959+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:30.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:30.395+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:30.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:30.935+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:31.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:31.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:31.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:31.979+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:32.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:32.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:32.981 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:32.975+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:33.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:33.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:33.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:33.959+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:34.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:34.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:35.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:34.999+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:35.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:35.299+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:36.022 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:36.019+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:36.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:36.299+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:36.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:36.995+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:37.260 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:37.255+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:38.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:38.011+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:38.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:38.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:39.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:39.011+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:39.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:39.279+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:40.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:40.047+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:40.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:40.299+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:41.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:41.079+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:41.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:41.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:42.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:42.103+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:42.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:42.367+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:43.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:43.123+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:43.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:43.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:44.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:44.155+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:44.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:44.371+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:45.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:45.195+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:45.392 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:45.387+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:46.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:46.223+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:46.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:46.411+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:47.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:47.203+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:47.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:47.375+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:48.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:48.223+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:48.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:48.423+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:49.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:49.231+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:49.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:49.431+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:50.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:50.279+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:50.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:50.411+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:51.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:51.311+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:51.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:51.443+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:52.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:52.271+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:52.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:52.407+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:53.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:53.267+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:53.460 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:53.455+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:54.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:54.319+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:54.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:54.499+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:55.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:55.306+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:55.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:55.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:56.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:56.270+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:56.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:56.562+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:57.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:57.262+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:57.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:57.610+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:58.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:58.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:58.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:58.574+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:59.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:35:59.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:35:59.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:35:59.590+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:00.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:00.250+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:00.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:00.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:01.300 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:01.294+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:01.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:01.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:02.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:02.306+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:02.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:02.594+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:03.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:03.302+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:03.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:03.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:04.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:04.294+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:04.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:04.598+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:05.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:05.346+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:05.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:05.606+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:06.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:06.382+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:06.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:06.654+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:07.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:07.346+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:07.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:07.674+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:08.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:08.390+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:08.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:08.642+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:09.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:09.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:09.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:09.646+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:10.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:10.470+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:10.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:10.614+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:11.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:11.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:11.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:11.582+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:12.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:12.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:12.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:12.570+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:13.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:13.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:13.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:13.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:14.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:14.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:14.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:14.582+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:15.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:15.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:15.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:15.626+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:16.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:16.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:16.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:16.594+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:17.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:17.482+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:17.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:17.618+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:18.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:18.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:18.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:18.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:19.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:19.474+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:19.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:19.614+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:20.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:20.518+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:20.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:20.566+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:21.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:21.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:21.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:21.566+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:22.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:22.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:22.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:22.550+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:23.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:23.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:23.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:23.518+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:24.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:24.490+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:24.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:24.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:25.460 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:25.454+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:25.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:25.526+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:26.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:26.442+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:26.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:26.498+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:27.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:27.422+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:27.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:27.474+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:28.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:28.470+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:28.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:28.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:29.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:29.506+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:29.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:29.534+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:30.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:30.490+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:30.547 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:30.542+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:31.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:31.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:31.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:31.542+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:32.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:32.526+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:32.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:32.554+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:33.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:33.494+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:33.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:33.550+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:34.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:34.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:34.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:34.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:35.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:35.490+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:35.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:35.534+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:36.504 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:36.498+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:36.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:36.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:37.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:37.454+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:37.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:37.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:38.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:38.486+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:38.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:38.526+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:39.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:39.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:39.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:39.538+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:40.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:40.498+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:40.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:40.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:41.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:41.457+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:41.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:41.537+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:42.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:42.501+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:42.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:42.557+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:43.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:43.457+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:43.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:43.517+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:44.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:44.413+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:44.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:44.545+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:45.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:45.381+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:45.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:45.581+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:46.399 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:46.393+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:46.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:46.537+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:47.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:47.429+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:47.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:47.585+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:48.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:48.453+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:48.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:48.545+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:49.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:49.505+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:49.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:49.569+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:50.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:50.501+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:50.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:50.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:51.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:51.529+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:51.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:51.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:52.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:52.529+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:52.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:52.637+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:53.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:53.505+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:53.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:53.641+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:54.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:54.509+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:54.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:54.621+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:55.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:55.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:55.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:55.617+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:56.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:56.593+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:56.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:56.601+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:57.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:57.605+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:57.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:57.633+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:58.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:58.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:58.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:58.685+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:59.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:36:59.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:36:59.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:36:59.705+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:00.656 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:00.653+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:00.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:00.749+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:01.655 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:01.653+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:01.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:01.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:02.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:02.669+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:02.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:02.761+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:03.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:03.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:03.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:03.777+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:04.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:04.657+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:04.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:04.821+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:05.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:05.625+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:05.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:05.809+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:06.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:06.581+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:06.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:06.861+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:07.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:07.593+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:07.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:07.901+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:08.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:08.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:08.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:08.941+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:09.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:09.593+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:09.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:09.953+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:10.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:10.641+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:10.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:10.913+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:11.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:11.613+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:11.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:11.885+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:12.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:12.601+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:12.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:12.909+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:13.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:13.569+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:13.955 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:13.953+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:14.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:14.601+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:14.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:14.969+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:15.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:15.609+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:15.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:15.973+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:16.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:16.597+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:17.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:17.021+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:17.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:17.613+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:18.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:18.017+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:18.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:18.629+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:19.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:19.021+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:19.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:19.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:20.055 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:20.053+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:20.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:20.689+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:21.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:21.065+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:21.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:21.721+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:22.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:22.065+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:22.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:22.681+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:23.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:23.073+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:23.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:23.645+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:24.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:24.073+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:24.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:24.637+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:25.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:25.113+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:25.664 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:25.661+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:26.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:26.085+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:26.650 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:26.649+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:27.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:27.089+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:27.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:27.677+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:28.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:28.100+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:28.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:28.712+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:29.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:29.128+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:29.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:29.688+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:30.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:30.124+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:30.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:30.736+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:31.153 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:31.152+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:31.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:31.708+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:32.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:32.200+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:32.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:32.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:33.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:33.196+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:33.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:33.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:34.177 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:34.172+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:34.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:34.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:35.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:35.136+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:35.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:35.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:36.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:36.176+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:36.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:36.756+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:37.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:37.172+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:37.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:37.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:38.162 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:38.160+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:38.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:38.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:39.211 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:39.208+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:39.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:39.720+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:40.258 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:40.256+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:40.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:40.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:41.247 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:41.244+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:41.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:41.684+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:42.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:42.236+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:42.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:42.636+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:43.247 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:43.244+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:43.636 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:43.632+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:44.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:44.228+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:44.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:44.628+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:45.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:45.220+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:45.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:45.588+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:46.205 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:46.200+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:46.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:46.592+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:47.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:47.196+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:47.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:47.560+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:48.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:48.192+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:48.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:48.568+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:49.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:49.228+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:49.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:49.608+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:50.194 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:50.192+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:50.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:50.612+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:51.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:51.192+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:51.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:51.636+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:52.186 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:52.184+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:52.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:52.608+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:53.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:53.220+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:53.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:53.640+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:54.216 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:54.212+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:54.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:54.680+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:55.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:55.236+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:55.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:55.720+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:56.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:56.264+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:56.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:56.700+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:57.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:57.308+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:57.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:57.716+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:58.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:58.336+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:58.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:58.684+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:59.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:37:59.336+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:37:59.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:37:59.724+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:00.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:00.336+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:00.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:00.756+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:01.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:01.372+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:01.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:01.708+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:02.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:02.344+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:02.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:02.704+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:03.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:03.308+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:03.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:03.680+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:04.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:04.352+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:04.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:04.684+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:05.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:05.392+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:05.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:05.708+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:06.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:06.416+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:06.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:06.664+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:07.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:07.384+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:07.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:07.696+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:08.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:08.420+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:08.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:08.704+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:09.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:09.416+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:09.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:09.696+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:10.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:10.412+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:10.744 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:10.740+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:11.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:11.428+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:11.783 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:11.780+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:12.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:12.456+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:12.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:12.772+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:13.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:13.484+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:13.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:13.768+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:14.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:14.436+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:14.812 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:14.807+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:15.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:15.479+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:15.768 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:15.763+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:16.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:16.519+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:16.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:16.795+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:17.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:17.571+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:17.817 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:17.811+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:18.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:18.543+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:18.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:18.819+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:19.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:19.555+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:19.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:19.779+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:20.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:20.579+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:20.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:20.823+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:21.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:21.615+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:21.792 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:21.787+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:22.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:22.635+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:22.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:22.751+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:23.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:23.615+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:23.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:23.719+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:24.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:24.651+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:24.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:24.671+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:25.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:25.651+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:25.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:25.687+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:26.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:26.659+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:26.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:26.695+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:27.659 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:27.655+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:27.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:27.699+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:28.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:28.667+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:28.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:28.679+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:29.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:29.683+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:29.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:29.687+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:30.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:30.639+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:30.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:30.691+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:31.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:31.607+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:31.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:31.667+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:32.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:32.647+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:32.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:32.683+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:33.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:33.671+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:33.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:33.735+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:34.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:34.679+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:34.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:34.687+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:35.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:35.655+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:35.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:35.707+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:36.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:36.627+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:36.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:36.747+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:37.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:37.587+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:37.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:37.711+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:38.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:38.551+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:38.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:38.731+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:39.602 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:39.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:39.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:39.743+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:40.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:40.551+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:40.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:40.791+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:41.583 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:41.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:41.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:41.751+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:42.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:42.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:42.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:42.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:43.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:43.575+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:43.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:43.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:44.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:44.607+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:44.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:44.679+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:45.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:45.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:45.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:45.703+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:46.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:46.591+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:46.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:46.751+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:47.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:47.575+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:47.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:47.783+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:48.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:48.615+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:48.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:48.739+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:49.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:49.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:49.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:49.723+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:50.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:50.623+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:50.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:50.751+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:51.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:51.623+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:51.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:51.735+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:52.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:52.583+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:52.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:52.707+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:53.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:53.603+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:53.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:53.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:54.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:54.555+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:54.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:54.699+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:55.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:55.519+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:55.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:55.743+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:56.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:56.527+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:56.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:56.707+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:57.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:57.531+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:57.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:57.679+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:58.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:58.519+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:58.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:58.727+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:59.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:38:59.551+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:38:59.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:38:59.771+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:00.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:00.595+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:00.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:00.794+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:01.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:01.614+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:01.791 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:01.786+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:02.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:02.658+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:02.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:02.794+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:03.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:03.682+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:03.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:03.794+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:04.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:04.690+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:04.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:04.786+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:05.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:05.646+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:05.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:05.806+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:06.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:06.686+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:06.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:06.774+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:07.676 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:07.670+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:07.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:07.778+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:08.664 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:08.658+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:08.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:08.734+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:09.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:09.654+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:09.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:09.742+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:10.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:10.626+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:10.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:10.738+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:11.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:11.594+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:11.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:11.726+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:12.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:12.602+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:12.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:12.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:13.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:13.578+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:13.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:13.694+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:14.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:14.594+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:14.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:14.658+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:15.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:15.554+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:15.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:15.630+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:16.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:16.546+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:16.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:16.630+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:17.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:17.574+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:17.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:17.622+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:18.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:18.566+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:18.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:18.654+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:19.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:19.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:19.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:19.630+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:20.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:20.542+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:20.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:20.614+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:21.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:21.538+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:21.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:21.570+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:22.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:22.494+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:22.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:22.574+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:23.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:23.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:23.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:23.558+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:24.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:24.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:24.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:24.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:25.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:25.402+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:25.525 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:25.522+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:26.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:26.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:26.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:26.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:27.394 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:27.390+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:27.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:27.522+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:28.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:28.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:28.480 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:28.474+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:29.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:29.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:29.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:29.494+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:30.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:30.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:30.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:30.542+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:31.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:31.430+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:31.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:31.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:32.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:32.386+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:32.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:32.570+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:33.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:33.426+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:33.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:33.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:34.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:34.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:34.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:34.510+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:35.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:35.494+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:35.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:35.558+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:36.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:36.462+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:36.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:36.602+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:37.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:37.470+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:37.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:37.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:38.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:38.430+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:38.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:38.554+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:39.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:39.478+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:39.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:39.550+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:40.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:40.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:40.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:40.526+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:41.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:41.498+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:41.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:41.574+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:42.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:42.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:42.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:42.566+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:43.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:43.466+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:43.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:43.562+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:44.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:44.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:44.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:44.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:45.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:45.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:45.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:45.498+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:46.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:46.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:46.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:46.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:47.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:47.477+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:47.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:47.513+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:48.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:48.509+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:48.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:48.513+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:49.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:49.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:49.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:49.505+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:50.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:50.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:50.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:50.477+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:51.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:51.469+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:51.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:51.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:52.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:52.441+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:52.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:52.485+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:53.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:53.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:53.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:53.473+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:54.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:54.389+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:54.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:54.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:55.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:55.353+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:55.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:55.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:56.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:56.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:56.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:56.385+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:57.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:57.373+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:57.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:57.377+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:58.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:58.361+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:58.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:58.381+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:59.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:39:59.369+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:39:59.375 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:39:59.373+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:00.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:00.357+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:00.403 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:00.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:01.370 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:01.369+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:01.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:01.381+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:02.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:02.353+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:02.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:02.353+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:03.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:03.329+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:03.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:03.337+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:04.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:04.297+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:04.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:04.317+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:05.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:05.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:05.331 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:05.329+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:06.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:06.265+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:06.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:06.365+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:07.223 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:07.221+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:07.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:07.373+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:08.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:08.189+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:08.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:08.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:09.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:09.209+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:09.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:09.417+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:10.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:10.237+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:10.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:10.389+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:11.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:11.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:11.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:11.353+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:12.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:12.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:12.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:12.329+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:13.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:13.277+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:13.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:13.349+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:14.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:14.289+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:14.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:14.361+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:15.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:15.253+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:15.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:15.321+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:16.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:16.205+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:16.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:16.305+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:17.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:17.193+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:17.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:17.313+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:18.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:18.189+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:18.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:18.309+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:19.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:19.197+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:19.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:19.313+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:20.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:20.173+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:20.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:20.289+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:21.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:21.141+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:21.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:21.273+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:22.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:22.097+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:22.228 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:22.225+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:23.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:23.109+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:23.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:23.265+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:24.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:24.085+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:24.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:24.237+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:25.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:25.113+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:25.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:25.233+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:26.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:26.133+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:26.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:26.269+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:27.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:27.113+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:27.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:27.277+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:28.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:28.081+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:28.259 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:28.257+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:29.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:29.045+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:29.245 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:29.241+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:30.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:30.025+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:30.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:30.229+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:31.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:31.025+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:31.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:31.181+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:31.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:31.993+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:32.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:32.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:33.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:32.997+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:33.180 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:33.176+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:33.981 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:33.980+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:34.194 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:34.192+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:34.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:34.988+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:35.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:35.204+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:36.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:36.028+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:36.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:36.228+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:37.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:37.036+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:37.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:37.236+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:38.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:38.000+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:38.276 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:38.272+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:38.982 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:38.980+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:39.259 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:39.256+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:39.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:39.984+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:40.251 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:40.248+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:40.956 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:40.952+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:41.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:41.224+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:41.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:41.972+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:42.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:42.200+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:42.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:42.984+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:43.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:43.160+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:43.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:43.992+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:44.133 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:44.128+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:44.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:44.952+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:45.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:45.084+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:45.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:45.988+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:46.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:46.044+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:46.946 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:46.944+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:47.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:47.064+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:47.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:47.916+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:48.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:48.084+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:48.940 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:48.936+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:49.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:49.076+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:49.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:49.968+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:50.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:50.112+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:50.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:50.924+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:51.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:51.156+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:51.953 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:51.948+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:52.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:52.120+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:52.920 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:52.916+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:53.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:53.096+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:53.915 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:53.912+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:54.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:54.140+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:54.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:54.964+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:55.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:55.172+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:55.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:55.928+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:56.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:56.156+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:56.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:56.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:57.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:57.140+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:57.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:57.964+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:58.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:58.136+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:58.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:58.976+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:59.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:40:59.108+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:40:59.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:40:59.952+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:00.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:00.112+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:00.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:00.944+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:01.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:01.104+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:01.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:01.920+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:02.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:02.132+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:02.896 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:02.892+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:03.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:03.148+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:03.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:03.932+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:04.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:04.196+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:04.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:04.940+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:05.225 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:05.220+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:05.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:05.904+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:06.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:06.268+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:06.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:06.940+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:07.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:07.316+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:07.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:07.980+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:08.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:08.328+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:08.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:08.972+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:09.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:09.360+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:09.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:09.996+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:10.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:10.408+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:10.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:10.956+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:11.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:11.364+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:11.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:11.936+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:12.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:12.320+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:12.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:12.984+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:13.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:13.272+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:13.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:13.964+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:14.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:14.300+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:14.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:14.940+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:15.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:15.268+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:15.900 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:15.896+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:16.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:16.292+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:16.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:16.896+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:17.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:17.320+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:17.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:17.928+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:18.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:18.280+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:18.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:18.972+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:19.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:19.271+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:19.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:19.987+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:20.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:20.283+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:21.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:21.023+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:21.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:21.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:22.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:22.055+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:22.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:22.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:23.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:23.095+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:23.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:23.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:24.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:24.123+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:24.331 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:24.327+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:25.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:25.095+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:25.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:25.375+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:26.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:26.139+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:26.410 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:26.407+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:27.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:27.131+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:27.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:27.371+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:28.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:28.171+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:28.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:28.331+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:29.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:29.203+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:29.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:29.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:30.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:30.203+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:30.314 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:30.311+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:31.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:31.223+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:31.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:31.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:32.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:32.215+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:32.306 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:32.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:33.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:33.255+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:33.296 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:33.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:34.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:34.279+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:34.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:34.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:35.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:35.303+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:35.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:35.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:36.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:36.311+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:36.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:36.375+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:37.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:37.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:37.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:37.355+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:38.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:38.299+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:38.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:38.375+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:39.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:39.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:39.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:39.375+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:40.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:40.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:40.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:40.367+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:41.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:41.327+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:41.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:41.395+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:42.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:42.347+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:42.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:42.367+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:43.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:43.327+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:43.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:43.335+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:44.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:44.319+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:44.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:44.339+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:45.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:45.283+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:45.325 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:45.319+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:46.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:46.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:46.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:46.319+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:47.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:47.283+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:47.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:47.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:48.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:48.251+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:48.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:48.283+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:49.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:49.227+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:49.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:49.331+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:50.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:50.219+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:50.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:50.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:51.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:51.179+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:51.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:51.311+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:52.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:52.195+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:52.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:52.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:53.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:53.171+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:53.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:53.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:54.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:54.143+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:54.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:54.395+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:55.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:55.111+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:55.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:55.375+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:56.104 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:56.099+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:56.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:56.419+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:57.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:57.055+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:57.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:57.383+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:58.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:58.075+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:58.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:58.415+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:59.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:41:59.035+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:41:59.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:41:59.431+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:00.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:00.075+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:00.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:00.403+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:01.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:01.119+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:01.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:01.379+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:02.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:02.123+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:02.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:02.363+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:03.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:03.131+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:03.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:03.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:04.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:04.131+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:04.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:04.395+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:05.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:05.146+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:05.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:05.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:06.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:06.102+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:06.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:06.406+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:07.095 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:07.090+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:07.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:07.438+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:08.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:08.114+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:08.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:08.430+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:09.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:09.094+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:09.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:09.466+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:10.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:10.090+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:10.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:10.514+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:11.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:11.066+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:11.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:11.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:12.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:12.022+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:12.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:12.566+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:12.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:12.990+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:13.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:13.538+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:13.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:13.966+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:14.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:14.546+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:14.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:14.938+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:15.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:15.582+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:15.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:15.970+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:16.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:16.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:16.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:16.942+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:17.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:17.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:17.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:17.994+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:18.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:18.610+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:18.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:18.946+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:19.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:19.598+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:19.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:19.942+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:20.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:20.646+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:20.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:20.954+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:21.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:21.678+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:21.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:21.966+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:22.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:22.646+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:23.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:23.014+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:23.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:23.610+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:24.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:24.014+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:24.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:24.622+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:25.037 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:25.034+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:25.597 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:25.590+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:25.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:25.986+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:26.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:26.630+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:27.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:27.026+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:27.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:27.666+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:28.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:28.002+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:28.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:28.702+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:29.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:29.022+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:29.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:29.738+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:30.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:30.030+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:30.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:30.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:31.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:31.078+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:31.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:31.722+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:32.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:32.038+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:32.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:32.674+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:33.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:33.062+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:33.727 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:33.722+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:34.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:34.070+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:34.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:34.770+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:35.057 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:35.050+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:35.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:35.762+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:36.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:36.094+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:36.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:36.814+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:37.142 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:37.138+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:37.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:37.766+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:38.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:38.098+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:38.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:38.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:39.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:39.094+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:39.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:39.782+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:40.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:40.142+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:40.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:40.754+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:41.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:41.194+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:41.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:41.794+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:42.187 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:42.182+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:42.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:42.762+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:43.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:43.210+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:43.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:43.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:44.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:44.258+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:44.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:44.782+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:45.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:45.282+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:45.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:45.762+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:46.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:46.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:46.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:46.794+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:47.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:47.338+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:47.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:47.762+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:48.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:48.362+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:48.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:48.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:49.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:49.338+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:49.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:49.742+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:50.303 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:50.298+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:50.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:50.730+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:51.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:51.273+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:51.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:51.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:52.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:52.321+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:52.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:52.701+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:53.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:53.305+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:53.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:53.657+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:54.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:54.317+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:54.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:54.621+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:55.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:55.333+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:55.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:55.637+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:56.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:56.305+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:56.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:56.677+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:57.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:57.333+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:57.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:57.657+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:58.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:58.317+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:58.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:58.689+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:59.286 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:42:59.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:42:59.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:42:59.701+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:00.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:00.325+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:00.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:00.661+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:01.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:01.365+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:01.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:01.645+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:02.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:02.353+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:02.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:02.621+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:03.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:03.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:03.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:03.613+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:04.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:04.337+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:04.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:04.585+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:05.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:05.389+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:05.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:05.613+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:06.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:06.393+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:06.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:06.621+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:07.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:07.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:07.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:07.573+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:08.335 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:08.333+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:08.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:08.597+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:09.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:09.345+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:09.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:09.585+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:10.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:10.385+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:10.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:10.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:11.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:11.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:11.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:11.561+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:12.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:12.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:12.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:12.601+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:13.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:13.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:13.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:13.561+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:14.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:14.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:14.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:14.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:15.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:15.477+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:15.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:15.561+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:16.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:16.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:16.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:16.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:17.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:17.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:17.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:17.625+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:18.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:18.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:18.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:18.629+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:19.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:19.549+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:19.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:19.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:20.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:20.509+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:20.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:20.637+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:21.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:21.517+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:21.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:21.601+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:22.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:22.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:22.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:22.637+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:23.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:23.493+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:23.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:23.601+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:24.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:24.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:24.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:24.565+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:25.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:25.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:25.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:25.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:26.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:26.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:26.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:26.589+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:27.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:27.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:27.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:27.553+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:28.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:28.425+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:28.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:28.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:29.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:29.429+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:29.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:29.537+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:30.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:30.429+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:30.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:30.577+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:31.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:31.449+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:31.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:31.537+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:32.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:32.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:32.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:32.501+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:33.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:33.489+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:33.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:33.517+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:34.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:34.497+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:34.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:34.497+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:35.452 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:35.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:35.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:35.525+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:36.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:36.456+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:36.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:36.524+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:37.442 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:37.440+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:37.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:37.516+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:38.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:38.440+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:38.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:38.532+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:39.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:39.484+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:39.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:39.504+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:40.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:40.500+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:40.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:40.532+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:41.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:41.496+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:41.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:41.508+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:42.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:42.484+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:42.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:42.508+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:43.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:43.440+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:43.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:43.480+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:44.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:44.424+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:44.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:44.464+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:45.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:45.416+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:45.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:45.452+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:46.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:46.420+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:46.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:46.432+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:47.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:47.372+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:47.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:47.424+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:48.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:48.380+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:48.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:48.400+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:49.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:49.376+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:49.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:49.380+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:50.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:50.368+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:50.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:50.392+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:51.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:51.376+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:51.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:51.376+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:52.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:52.352+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:52.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:52.420+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:53.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:53.312+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:53.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:53.432+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:54.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:54.360+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:54.392 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:54.388+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:55.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:55.348+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:55.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:55.424+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:56.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:56.396+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:56.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:56.416+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:57.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:57.420+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:57.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:57.432+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:58.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:58.420+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:58.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:58.456+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:59.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:43:59.416+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:43:59.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:43:59.452+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:00.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:00.424+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:00.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:00.456+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:01.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:01.416+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:01.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:01.456+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:02.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:02.376+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:02.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:02.472+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:03.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:03.404+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:03.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:03.524+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:04.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:04.380+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:04.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:04.548+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:05.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:05.356+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:05.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:05.548+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:06.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:06.316+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:06.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:06.572+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:07.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:07.364+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:07.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:07.536+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:08.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:08.368+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:08.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:08.552+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:09.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:09.400+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:09.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:09.524+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:10.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:10.408+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:10.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:10.508+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:11.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:11.428+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:11.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:11.552+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:12.399 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:12.396+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:12.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:12.588+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:13.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:13.384+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:13.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:13.612+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:14.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:14.408+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:14.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:14.652+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:15.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:15.372+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:15.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:15.616+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:16.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:16.368+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:16.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:16.640+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:17.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:17.380+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:17.655 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:17.652+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:18.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:18.348+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:18.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:18.652+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:19.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:19.304+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:19.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:19.624+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:20.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:20.344+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:20.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:20.620+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:21.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:21.352+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:21.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:21.640+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:22.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:22.391+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:22.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:22.631+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:23.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:23.355+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:23.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:23.623+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:24.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:24.363+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:24.602 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:24.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:25.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:25.371+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:25.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:25.647+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:26.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:26.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:26.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:26.639+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:27.309 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:27.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:27.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:27.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:28.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:28.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:28.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:28.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:29.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:29.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:29.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:29.579+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:30.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:30.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:30.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:30.627+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:31.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:31.367+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:31.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:31.631+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:32.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:32.395+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:32.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:32.643+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:33.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:33.367+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:33.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:33.643+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:34.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:34.359+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:34.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:34.619+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:35.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:35.343+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:35.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:35.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:36.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:36.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:36.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:36.575+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:37.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:37.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:37.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:37.539+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:38.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:38.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:38.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:38.571+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:39.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:39.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:39.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:39.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:40.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:40.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:40.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:40.603+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:41.306 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:41.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:41.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:41.611+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:42.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:42.299+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:42.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:42.619+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:43.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:43.279+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:43.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:43.619+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:44.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:44.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:44.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:44.663+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:45.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:45.311+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:45.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:45.663+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:46.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:46.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:46.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:46.615+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:47.327 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:47.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:47.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:47.607+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:48.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:48.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:48.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:48.571+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:49.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:49.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:49.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:49.583+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:50.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:50.271+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:50.621 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:50.615+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:51.256 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:51.251+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:51.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:51.583+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:52.215 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:52.211+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:52.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:52.599+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:53.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:53.195+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:53.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:53.635+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:54.208 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:54.203+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:54.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:54.591+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:55.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:55.167+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:55.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:55.587+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:56.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:56.135+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:56.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:56.639+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:57.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:57.103+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:57.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:57.651+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:58.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:58.095+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:58.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:58.699+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:59.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:44:59.135+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:44:59.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:44:59.691+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:00.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:00.139+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:00.715 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:00.711+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:01.171 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:01.167+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:01.744 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:01.739+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:02.215 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:02.211+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:02.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:02.707+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:03.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:03.215+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:03.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:03.671+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:04.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:04.227+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:04.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:04.659+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:05.190 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:05.187+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:05.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:05.683+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:06.228 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:06.223+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:06.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:06.707+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:07.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:07.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:07.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:07.742+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:08.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:08.314+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:08.790 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:08.786+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:09.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:09.350+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:09.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:09.738+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:10.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:10.374+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:10.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:10.754+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:11.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:11.390+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:11.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:11.710+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:12.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:12.374+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:12.696 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:12.690+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:13.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:13.346+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:13.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:13.690+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:14.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:14.306+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:14.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:14.642+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:15.278 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:15.274+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:15.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:15.594+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:16.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:16.274+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:16.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:16.578+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:17.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:17.250+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:17.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:17.570+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:18.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:18.226+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:18.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:18.574+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:19.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:19.194+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:19.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:19.566+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:20.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:20.226+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:20.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:20.566+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:21.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:21.254+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:21.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:21.586+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:22.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:22.234+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:22.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:22.578+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:23.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:23.266+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:23.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:23.558+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:24.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:24.282+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:24.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:24.514+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:25.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:25.290+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:25.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:25.502+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:26.268 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:26.262+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:26.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:26.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:27.239 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:27.234+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:27.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:27.542+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:28.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:28.194+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:28.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:28.522+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:29.166 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:29.162+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:29.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:29.510+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:30.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:30.134+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:30.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:30.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:31.145 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:31.138+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:31.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:31.490+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:32.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:32.114+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:32.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:32.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:33.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:33.078+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:33.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:33.442+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:34.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:34.042+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:34.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:34.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:35.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:35.022+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:35.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:35.422+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:36.043 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:36.038+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:36.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:36.414+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:37.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:37.042+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:37.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:37.446+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:38.001 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:37.998+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:38.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:38.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:39.009 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:39.006+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:39.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:39.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:40.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:39.998+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:40.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:40.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:40.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:40.990+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:41.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:41.434+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:41.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:41.942+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:42.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:42.422+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:42.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:42.938+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:43.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:43.418+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:43.968 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:43.962+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:44.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:44.410+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:44.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:44.926+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:45.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:45.426+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:45.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:45.946+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:46.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:46.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:46.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:46.898+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:47.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:47.406+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:47.915 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:47.910+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:48.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:48.374+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:48.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:48.866+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:49.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:49.378+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:49.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:49.910+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:50.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:50.426+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:50.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:50.926+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:51.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:51.458+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:51.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:51.934+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:52.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:52.438+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:52.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:52.958+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:53.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:53.393+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:54.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:53.997+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:54.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:54.361+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:55.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:55.041+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:55.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:55.381+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:56.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:56.033+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:56.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:56.425+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:57.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:57.033+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:57.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:57.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:58.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:58.073+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:58.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:58.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:59.052 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:45:59.049+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:45:59.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:45:59.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:00.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:00.085+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:00.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:00.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:01.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:01.053+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:01.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:01.453+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:02.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:02.097+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:02.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:02.469+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:03.096 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:03.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:03.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:03.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:04.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:04.077+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:04.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:04.493+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:05.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:05.041+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:05.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:05.525+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:06.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:06.049+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:06.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:06.485+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:07.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:07.001+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:07.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:07.449+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:08.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:08.033+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:08.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:08.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:09.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:09.065+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:09.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:09.357+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:10.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:10.053+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:10.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:10.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:11.105 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:11.101+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:11.349 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:11.345+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:12.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:12.145+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:12.375 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:12.373+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:13.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:13.117+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:13.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:13.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:14.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:14.073+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:14.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:14.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:15.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:15.105+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:15.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:15.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:16.123 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:16.121+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:16.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:16.437+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:17.111 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:17.109+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:17.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:17.389+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:18.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:18.093+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:18.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:18.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:19.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:19.137+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:19.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:19.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:20.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:20.177+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:20.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:20.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:21.159 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:21.157+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:21.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:21.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:22.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:22.125+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:22.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:22.369+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:23.166 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:23.165+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:23.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:23.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:24.124 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:24.121+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:24.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:24.401+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:25.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:25.149+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:25.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:25.361+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:26.201 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:26.201+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:26.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:26.373+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:27.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:27.189+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:27.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:27.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:28.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:28.237+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:28.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:28.313+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:29.242 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:29.241+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:29.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:29.313+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:30.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:30.225+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:30.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:30.317+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:31.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:31.253+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:31.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:31.285+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:32.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:32.245+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:32.296 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:32.293+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:33.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:33.241+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:33.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:33.341+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:34.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:34.241+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:34.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:34.309+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:35.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:35.241+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:35.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:35.357+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:36.231 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:36.229+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:36.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:36.353+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:37.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:37.205+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:37.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:37.381+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:38.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:38.201+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:38.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:38.381+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:39.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:39.184+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:39.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:39.336+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:40.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:40.172+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:40.357 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:40.352+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:41.192 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:41.188+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:41.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:41.348+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:42.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:42.236+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:42.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:42.396+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:43.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:43.272+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:43.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:43.372+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:44.303 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:44.300+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:44.370 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:44.368+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:45.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:45.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:45.370 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:45.368+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:46.294 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:46.292+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:46.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:46.348+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:47.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:47.272+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:47.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:47.316+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:48.294 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:48.292+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:48.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:48.344+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:49.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:49.292+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:49.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:49.348+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:50.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:50.340+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:50.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:50.344+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:51.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:51.344+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:51.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:51.384+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:52.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:52.312+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:52.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:52.380+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:53.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:53.300+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:53.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:53.428+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:54.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:54.316+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:54.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:54.460+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:55.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:55.280+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:55.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:55.492+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:56.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:56.324+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:56.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:56.480+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:57.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:57.312+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:57.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:57.504+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:58.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:58.288+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:58.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:58.532+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:59.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:46:59.324+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:46:59.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:46:59.564+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:00.309 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:00.304+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:00.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:00.596+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:01.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:01.284+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:01.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:01.616+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:02.263 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:02.260+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:02.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:02.628+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:03.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:03.288+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:03.679 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:03.676+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:04.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:04.316+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:04.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:04.704+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:05.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:05.296+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:05.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:05.680+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:06.262 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:06.260+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:06.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:06.640+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:07.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:07.268+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:07.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:07.640+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:08.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:08.256+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:08.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:08.620+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:09.248 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:09.244+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:09.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:09.584+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:10.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:10.288+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:10.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:10.628+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:11.278 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:11.276+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:11.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:11.644+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:12.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:12.324+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:12.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:12.688+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:13.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:13.280+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:13.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:13.644+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:14.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:14.308+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:14.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:14.616+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:15.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:15.324+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:15.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:15.572+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:16.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:16.376+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:16.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:16.544+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:17.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:17.404+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:17.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:17.520+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:18.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:18.396+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:18.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:18.492+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:19.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:19.352+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:19.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:19.528+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:20.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:20.344+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:20.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:20.524+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:21.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:21.376+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:21.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:21.508+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:22.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:22.404+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:22.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:22.508+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:23.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:23.372+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:23.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:23.480+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:24.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:24.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:24.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:24.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:25.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:25.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:25.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:25.451+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:26.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:26.311+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:26.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:26.455+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:27.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:27.319+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:27.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:27.507+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:28.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:28.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:28.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:28.491+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:29.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:29.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:29.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:29.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:30.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:30.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:30.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:30.439+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:31.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:31.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:31.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:31.475+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:32.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:32.279+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:32.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:32.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:33.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:33.263+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:33.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:33.403+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:34.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:34.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:34.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:34.439+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:35.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:35.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:35.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:35.395+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:36.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:36.323+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:36.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:36.399+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:37.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:37.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:37.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:37.383+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:38.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:38.271+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:38.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:38.391+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:39.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:39.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:39.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:39.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:40.252 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:40.247+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:40.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:40.419+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:41.209 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:41.203+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:41.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:41.395+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:42.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:42.195+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:42.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:42.419+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:43.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:43.151+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:43.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:43.411+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:44.146 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:44.143+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:44.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:44.443+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:45.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:45.179+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:45.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:45.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:46.207 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:46.203+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:46.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:46.447+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:47.209 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:47.203+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:47.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:47.463+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:48.170 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:48.167+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:48.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:48.463+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:49.147 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:49.143+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:49.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:49.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:50.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:50.099+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:50.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:50.527+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:51.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:51.115+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:51.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:51.547+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:52.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:52.107+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:52.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:52.543+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:53.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:53.155+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:53.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:53.559+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:54.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:54.179+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:54.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:54.603+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:55.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:55.151+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:55.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:55.615+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:56.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:56.191+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:56.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:56.663+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:57.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:57.167+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:57.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:57.707+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:58.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:58.199+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:58.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:58.735+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:59.252 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:47:59.247+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:47:59.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:47:59.787+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:00.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:00.203+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:00.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:00.787+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:01.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:01.235+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:01.815 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:01.811+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:02.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:02.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:02.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:02.771+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:03.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:03.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:03.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:03.759+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:04.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:04.279+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:04.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:04.779+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:05.260 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:05.255+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:05.755 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:05.751+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:06.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:06.251+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:06.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:06.703+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:07.208 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:07.203+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:07.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:07.679+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:08.178 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:08.175+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:08.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:08.691+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:09.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:09.135+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:09.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:09.682+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:10.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:10.142+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:10.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:10.726+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:11.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:11.194+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:11.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:11.726+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:12.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:12.226+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:12.766 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:12.762+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:13.211 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:13.206+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:13.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:13.802+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:14.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:14.250+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:14.856 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:14.850+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:15.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:15.242+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:15.812 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:15.806+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:16.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:16.262+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:16.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:16.790+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:17.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:17.262+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:17.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:17.802+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:18.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:18.294+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:18.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:18.762+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:19.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:19.338+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:19.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:19.790+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:20.381 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:20.374+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:20.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:20.786+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:21.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:21.394+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:21.744 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:21.738+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:22.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:22.398+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:22.792 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:22.786+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:23.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:23.394+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:23.835 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:23.830+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:24.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:24.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:24.881 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:24.874+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:25.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:25.430+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:25.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:25.846+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:26.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:26.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:26.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:26.866+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:27.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:27.490+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:27.880 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:27.874+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:28.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:28.442+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:28.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:28.914+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:29.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:29.478+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:29.874 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:29.870+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:30.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:30.502+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:30.860 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:30.854+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:31.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:31.550+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:31.842 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:31.838+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:32.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:32.574+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:32.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:32.838+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:33.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:33.586+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:33.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:33.862+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:34.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:34.538+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:34.914 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:34.910+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:35.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:35.514+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:35.920 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:35.914+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:36.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:36.514+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:36.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:36.930+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:37.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:37.534+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:37.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:37.914+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:38.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:38.494+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:38.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:38.938+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:39.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:39.498+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:39.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:39.902+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:40.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:40.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:40.880 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:40.874+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:41.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:41.498+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:41.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:41.846+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:42.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:42.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:42.806 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:42.802+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:43.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:43.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:43.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:43.806+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:44.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:44.470+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:44.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:44.770+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:45.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:45.470+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:45.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:45.734+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:46.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:46.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:46.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:46.758+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:47.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:47.454+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:47.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:47.778+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:48.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:48.450+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:48.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:48.826+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:49.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:49.422+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:49.785 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:49.778+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:50.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:50.430+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:50.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:50.746+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:51.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:51.406+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:51.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:51.746+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:52.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:52.382+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:52.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:52.742+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:53.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:53.386+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:53.792 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:53.786+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:54.384 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:54.378+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:54.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:54.830+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:55.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:55.389+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:55.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:55.821+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:56.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:56.417+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:56.879 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:56.873+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:57.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:57.441+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:57.915 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:57.909+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:58.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:58.445+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:58.910 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:58.905+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:59.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:48:59.409+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:48:59.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:48:59.945+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:00.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:00.369+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:00.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:00.929+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:01.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:01.381+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:01.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:01.933+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:02.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:02.401+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:02.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:02.981+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:03.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:03.373+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:04.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:04.001+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:04.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:04.401+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:05.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:05.037+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:05.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:05.449+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:06.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:06.049+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:06.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:06.421+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:07.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:07.085+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:07.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:07.457+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:08.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:08.129+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:08.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:08.493+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:09.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:09.161+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:09.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:09.525+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:10.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:10.125+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:10.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:10.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:11.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:11.089+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:11.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:11.545+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:12.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:12.045+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:12.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:12.557+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:13.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:13.041+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:13.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:13.601+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:14.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:14.017+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:14.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:14.649+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:15.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:15.057+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:15.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:15.649+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:16.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:16.057+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:16.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:16.637+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:17.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:17.081+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:17.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:17.597+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:18.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:18.049+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:18.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:18.621+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:19.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:19.069+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:19.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:19.653+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:20.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:20.073+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:20.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:20.685+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:21.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:21.117+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:21.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:21.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:22.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:22.081+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:22.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:22.709+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:23.122 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:23.121+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:23.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:23.729+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:24.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:24.073+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:24.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:24.721+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:25.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:25.081+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:25.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:25.717+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:26.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:26.085+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:26.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:26.745+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:27.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:27.037+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:27.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:27.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:28.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:28.045+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:28.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:28.717+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:29.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:29.021+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:29.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:29.709+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:30.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:30.041+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:30.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:30.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:31.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:31.041+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:31.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:31.765+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:32.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:32.033+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:32.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:32.733+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:32.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:32.993+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:33.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:33.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:33.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:33.973+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:34.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:34.701+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:34.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:34.977+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:35.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:35.681+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:36.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:36.017+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:36.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:36.701+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:37.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:37.049+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:37.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:37.721+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:38.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:38.021+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:38.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:38.761+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:38.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:38.981+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:39.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:39.741+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:39.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:39.985+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:40.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:40.756+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:41.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:41.008+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:41.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:41.732+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:42.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:42.016+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:42.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:42.776+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:43.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:43.060+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:43.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:43.776+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:44.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:44.048+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:44.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:44.824+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:45.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:45.092+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:45.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:45.840+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:46.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:46.068+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:46.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:46.848+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:47.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:47.048+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:47.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:47.872+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:48.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:48.036+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:48.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:48.836+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:49.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:49.008+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:49.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:49.820+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:50.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:50.056+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:50.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:50.776+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:51.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:51.088+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:51.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:51.808+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:52.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:52.044+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:52.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:52.812+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:53.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:53.004+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:53.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:53.852+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:54.056 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:54.052+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:54.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:54.820+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:55.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:55.024+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:55.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:55.820+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:56.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:56.048+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:56.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:56.796+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:57.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:57.096+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:57.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:57.792+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:58.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:58.092+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:58.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:58.744+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:59.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:49:59.124+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:49:59.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:49:59.792+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:00.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:00.132+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:00.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:00.780+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:01.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:01.096+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:01.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:01.804+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:02.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:02.128+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:02.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:02.844+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:03.164 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:03.160+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:03.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:03.852+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:04.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:04.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:04.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:04.836+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:05.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:05.172+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:05.868 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:05.864+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:06.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:06.188+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:06.883 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:06.880+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:07.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:07.172+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:07.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:07.852+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:08.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:08.168+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:08.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:08.832+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:09.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:09.176+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:09.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:09.856+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:10.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:10.188+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:10.812 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:10.808+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:11.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:11.168+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:11.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:11.844+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:12.138 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:12.136+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:12.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:12.888+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:13.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:13.156+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:13.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:13.904+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:14.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:14.124+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:14.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:14.908+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:15.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:15.168+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:15.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:15.948+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:16.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:16.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:16.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:16.928+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:17.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:17.196+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:17.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:17.952+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:18.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:18.212+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:18.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:18.976+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:19.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:19.256+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:19.973 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:19.968+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:20.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:20.228+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:20.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:20.992+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:21.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:21.276+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:22.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:22.020+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:22.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:22.244+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:23.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:23.068+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:23.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:23.232+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:24.096 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:24.092+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:24.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:24.188+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:25.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:25.116+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:25.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:25.212+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:26.153 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:26.151+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:26.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:26.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:27.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:27.123+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:27.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:27.207+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:28.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:28.087+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:28.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:28.255+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:29.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:29.115+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:29.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:29.235+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:30.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:30.155+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:30.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:30.235+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:31.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:31.171+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:31.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:31.215+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:32.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:32.187+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:32.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:32.191+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:33.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:33.159+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:33.207 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:33.203+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:34.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:34.139+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:34.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:34.251+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:35.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:35.123+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:35.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:35.283+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:36.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:36.151+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:36.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:36.319+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:37.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:37.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:37.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:37.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:38.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:38.207+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:38.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:38.303+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:39.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:39.215+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:39.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:39.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:40.185 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:40.179+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:40.357 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:40.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:41.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:41.143+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:41.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:41.351+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:42.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:42.187+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:42.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:42.315+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:43.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:43.195+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:43.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:43.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:44.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:44.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:44.297 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:44.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:45.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:45.167+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:45.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:45.251+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:46.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:46.135+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:46.210 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:46.207+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:47.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:47.091+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:47.211 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:47.207+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:48.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:48.143+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:48.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:48.227+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:49.191 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:49.187+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:49.239 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:49.235+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:50.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:50.191+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:50.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:50.275+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:51.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:51.203+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:51.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:51.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:52.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:52.219+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:52.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:52.291+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:53.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:53.259+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:53.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:53.307+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:54.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:54.251+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:54.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:54.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:55.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:55.259+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:55.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:55.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:56.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:56.275+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:56.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:56.339+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:57.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:57.275+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:57.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:57.335+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:58.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:58.295+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:58.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:58.311+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:59.262 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:50:59.259+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:50:59.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:50:59.279+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:00.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:00.299+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:00.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:00.307+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:01.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:01.287+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:01.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:01.347+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:02.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:02.327+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:02.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:02.387+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:03.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:03.343+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:03.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:03.407+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:04.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:04.367+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:04.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:04.379+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:05.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:05.319+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:05.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:05.351+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:06.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:06.347+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:06.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:06.359+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:07.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:07.367+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:07.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:07.387+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:08.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:08.411+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:08.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:08.435+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:09.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:09.443+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:09.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:09.471+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:10.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:10.431+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:10.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:10.503+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:11.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:11.390+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:11.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:11.454+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:12.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:12.414+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:12.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:12.482+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:13.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:13.370+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:13.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:13.530+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:14.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:14.422+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:14.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:14.546+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:15.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:15.414+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:15.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:15.566+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:16.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:16.434+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:16.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:16.590+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:17.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:17.422+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:17.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:17.586+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:18.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:18.410+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:18.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:18.590+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:19.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:19.446+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:19.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:19.630+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:20.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:20.422+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:20.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:20.610+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:21.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:21.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:21.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:21.582+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:22.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:22.450+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:22.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:22.602+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:23.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:23.462+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:23.640 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:23.634+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:24.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:24.514+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:24.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:24.686+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:25.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:25.530+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:25.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:25.698+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:26.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:26.490+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:26.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:26.734+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:27.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:27.514+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:27.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:27.706+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:28.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:28.562+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:28.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:28.710+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:29.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:29.582+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:29.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:29.670+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:30.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:30.594+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:30.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:30.634+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:31.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:31.558+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:31.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:31.670+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:32.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:32.606+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:32.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:32.662+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:33.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:33.622+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:33.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:33.626+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:34.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:34.666+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:34.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:34.666+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:35.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:35.646+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:35.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:35.690+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:36.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:36.610+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:36.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:36.718+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:37.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:37.586+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:37.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:37.734+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:38.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:38.634+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:38.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:38.750+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:39.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:39.610+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:39.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:39.758+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:40.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:40.586+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:40.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:40.754+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:41.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:41.626+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:41.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:41.722+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:42.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:42.598+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:42.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:42.718+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:43.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:43.602+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:43.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:43.694+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:44.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:44.606+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:44.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:44.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:45.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:45.594+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:45.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:45.714+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:46.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:46.622+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:46.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:46.702+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:47.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:47.618+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:47.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:47.698+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:48.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:48.626+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:48.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:48.682+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:49.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:49.582+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:49.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:49.726+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:50.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:50.538+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:50.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:50.726+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:51.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:51.526+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:51.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:51.726+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:52.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:52.498+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:52.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:52.754+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:53.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:53.514+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:53.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:53.774+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:54.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:54.554+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:54.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:54.782+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:55.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:55.506+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:55.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:55.810+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:56.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:56.461+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:56.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:56.829+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:57.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:57.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:57.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:57.813+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:58.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:58.433+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:58.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:58.781+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:59.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:51:59.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:51:59.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:51:59.781+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:00.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:00.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:00.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:00.769+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:01.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:01.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:01.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:01.777+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:02.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:02.489+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:02.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:02.813+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:03.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:03.509+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:03.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:03.829+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:04.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:04.489+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:04.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:04.781+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:05.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:05.489+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:05.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:05.761+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:06.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:06.445+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:06.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:06.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:07.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:07.425+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:07.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:07.725+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:08.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:08.421+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:08.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:08.765+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:09.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:09.397+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:09.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:09.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:10.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:10.381+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:10.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:10.745+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:11.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:11.377+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:11.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:11.789+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:12.349 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:12.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:12.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:12.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:13.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:13.393+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:13.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:13.773+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:14.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:14.353+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:14.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:14.749+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:15.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:15.349+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:15.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:15.745+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:16.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:16.389+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:16.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:16.701+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:17.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:17.417+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:17.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:17.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:18.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:18.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:18.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:18.749+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:19.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:19.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:19.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:19.749+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:20.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:20.509+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:20.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:20.705+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:21.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:21.481+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:21.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:21.725+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:22.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:22.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:22.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:22.773+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:23.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:23.513+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:23.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:23.753+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:24.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:24.477+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:24.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:24.725+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:25.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:25.493+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:25.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:25.769+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:26.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:26.505+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:26.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:26.769+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:27.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:27.473+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:27.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:27.781+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:28.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:28.501+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:28.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:28.737+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:29.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:29.457+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:29.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:29.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:30.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:30.425+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:30.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:30.713+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:31.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:31.409+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:31.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:31.733+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:32.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:32.369+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:32.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:32.769+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:33.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:33.413+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:33.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:33.797+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:34.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:34.369+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:34.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:34.781+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:35.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:35.321+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:35.828 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:35.825+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:36.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:36.301+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:36.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:36.805+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:37.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:37.277+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:37.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:37.845+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:38.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:38.321+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:38.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:38.813+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:39.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:39.353+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:39.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:39.801+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:40.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:40.365+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:40.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:40.853+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:41.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:41.364+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:41.880 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:41.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:42.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:42.320+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:42.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:42.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:43.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:43.272+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:43.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:43.852+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:44.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:44.264+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:44.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:44.864+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:45.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:45.268+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:45.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:45.908+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:46.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:46.280+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:46.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:46.880+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:47.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:47.312+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:47.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:47.868+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:48.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:48.268+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:48.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:48.852+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:49.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:49.284+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:49.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:49.832+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:50.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:50.300+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:50.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:50.792+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:51.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:51.284+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:51.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:51.780+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:52.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:52.328+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:52.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:52.800+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:53.294 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:53.292+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:53.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:53.824+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:54.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:54.296+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:54.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:54.804+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:55.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:55.248+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:55.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:55.804+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:56.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:56.276+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:56.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:56.828+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:57.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:57.240+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:57.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:57.864+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:58.196 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:58.192+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:58.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:58.880+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:59.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:52:59.240+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:52:59.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:52:59.888+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:00.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:00.232+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:00.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:00.868+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:01.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:01.284+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:01.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:01.888+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:02.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:02.276+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:02.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:02.864+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:03.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:03.304+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:03.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:03.824+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:04.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:04.312+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:04.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:04.868+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:05.286 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:05.284+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:05.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:05.836+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:06.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:06.296+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:06.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:06.888+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:07.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:07.332+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:07.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:07.940+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:08.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:08.320+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:08.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:08.908+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:09.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:09.280+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:09.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:09.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:10.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:10.248+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:10.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:10.860+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:11.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:11.236+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:11.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:11.876+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:12.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:12.212+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:12.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:12.908+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:13.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:13.260+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:13.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:13.916+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:14.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:14.244+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:14.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:14.944+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:15.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:15.212+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:15.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:15.916+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:16.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:16.204+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:16.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:16.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:17.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:17.252+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:17.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:17.884+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:18.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:18.284+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:18.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:18.892+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:19.280 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:19.276+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:19.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:19.920+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:20.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:20.228+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:20.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:20.904+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:21.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:21.236+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:21.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:21.868+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:22.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:22.208+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:22.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:22.896+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:23.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:23.228+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:23.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:23.936+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:24.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:24.200+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:24.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:24.980+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:25.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:25.228+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:25.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:25.943+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:26.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:26.247+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:26.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:26.975+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:27.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:27.251+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:27.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:27.935+0000 7fdbba384700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:28.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:28.283+0000 7f9d10566700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:28.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:28.891+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:29.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:29.295+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:29.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:29.843+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:30.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:30.271+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:30.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:30.847+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:31.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:31.263+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:31.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:31.879+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:32.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:32.279+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:32.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:32.867+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:33.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:33.299+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:33.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:33.847+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:34.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:34.311+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:34.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:34.831+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:35.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:35.363+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:35.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:35.839+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:36.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:36.339+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:36.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:36.863+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:37.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:37.311+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:37.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:37.823+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:38.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:38.339+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:38.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:38.779+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:39.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:39.307+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:39.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:39.811+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:40.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:40.275+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:40.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:40.783+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:41.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:41.315+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:41.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:41.743+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:42.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:42.323+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:42.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:42.779+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:43.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:43.315+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:43.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:43.775+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:44.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:44.359+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:44.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:44.815+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:45.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:45.379+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:45.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:45.771+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:46.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:46.359+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:46.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:46.787+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:47.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:47.367+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:47.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:47.819+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:48.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:48.383+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:48.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:48.819+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:49.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:49.379+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:49.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:49.843+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:50.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:50.419+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:50.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:50.831+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:51.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:51.427+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:51.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:51.815+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:52.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:52.463+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:52.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:52.799+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:53.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:53.495+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:53.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:53.815+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:54.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:54.471+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:54.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:54.823+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:55.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:55.523+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:55.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:55.807+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:56.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:56.475+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:56.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:56.819+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:57.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:57.515+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:57.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:57.827+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:58.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:58.555+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:58.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:58.843+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:59.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:53:59.511+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:53:59.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:53:59.843+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:00.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:00.463+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:00.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:00.843+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:01.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:01.439+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:01.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:01.819+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:02.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:02.407+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:02.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:02.835+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:03.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:03.395+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:03.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:03.847+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:04.394 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:04.391+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:04.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:04.891+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:05.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:05.359+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:05.945 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:05.939+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:06.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:06.339+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:06.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:06.939+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:07.303 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:07.299+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:07.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:07.991+0000 7fdbba384700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:08.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:08.303+0000 7f9d10566700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:08.987 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:08.983+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:09.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:09.255+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:09.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:09.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:10.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:10.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:10.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:10.954+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:11.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:11.266+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:11.997 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:11.990+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:12.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:12.286+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:12.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:12.970+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:13.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:13.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:14.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:14.018+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:14.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:14.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:15.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:15.002+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:15.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:15.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:15.993 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:15.986+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:16.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:16.370+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:16.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:16.954+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:17.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:17.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:17.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:17.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:18.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:18.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:18.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:18.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:19.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:19.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:19.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:19.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:20.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:20.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:20.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:20.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:21.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:21.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:21.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:21.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:22.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:22.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:22.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:22.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:23.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:23.514+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:23.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:23.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:24.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:24.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:24.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:24.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:25.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:25.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:25.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:25.930+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:26.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:26.402+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:26.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:26.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:27.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:27.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:27.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:27.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:28.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:28.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:28.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:28.854+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:29.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:29.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:29.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:29.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:30.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:30.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:30.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:30.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:31.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:31.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:31.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:31.906+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:32.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:32.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:32.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:32.906+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:33.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:33.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:33.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:33.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:34.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:34.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:34.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:34.970+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:35.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:35.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:35.978 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:35.974+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:36.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:36.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:36.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:36.934+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:37.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:37.338+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:37.946 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:37.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:38.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:38.374+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:38.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:38.938+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:39.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:39.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:39.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:39.914+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:40.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:40.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:40.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:40.934+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:41.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:41.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:41.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:41.934+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:42.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:42.470+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:42.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:42.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:43.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:43.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:43.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:43.978+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:44.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:44.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:44.971 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:44.966+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:45.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:45.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:45.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:45.950+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:46.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:46.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:46.995 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:46.990+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:47.500 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:47.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:48.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:48.022+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:48.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:48.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:49.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:48.998+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:49.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:49.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:49.990 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:49.986+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:50.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:50.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:51.010 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:51.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:51.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:51.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:52.001 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:51.994+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:52.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:52.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:52.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:52.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:53.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:53.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:53.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:53.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:54.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:54.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:54.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:54.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:55.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:55.497+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:55.983 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:55.977+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:56.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:56.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:57.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:57.021+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:57.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:57.529+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:58.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:58.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:58.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:58.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:59.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:54:59.121+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:54:59.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:54:59.545+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:00.124 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:00.117+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:00.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:00.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:01.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:01.149+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:01.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:01.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:02.196 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:02.193+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:02.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:02.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:03.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:03.165+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:03.640 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:03.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:04.213 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:04.209+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:04.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:04.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:05.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:05.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:05.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:05.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:06.216 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:06.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:06.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:06.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:07.262 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:07.261+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:07.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:07.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:08.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:08.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:08.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:08.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:09.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:09.245+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:09.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:09.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:10.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:10.233+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:10.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:10.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:11.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:11.189+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:11.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:11.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:12.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:12.181+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:12.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:12.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:13.177 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:13.173+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:13.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:13.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:14.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:14.153+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:14.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:14.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:15.178 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:15.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:15.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:15.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:16.133 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:16.129+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:16.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:16.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:17.099 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:17.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:17.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:17.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:18.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:18.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:18.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:18.553+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:19.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:19.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:19.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:19.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:20.190 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:20.189+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:20.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:20.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:21.201 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:21.197+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:21.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:21.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:22.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:22.165+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:22.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:22.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:23.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:23.153+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:23.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:23.477+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:24.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:24.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:24.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:24.441+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:25.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:25.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:25.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:25.413+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:26.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:26.117+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:26.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:26.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:27.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:27.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:27.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:27.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:28.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:28.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:28.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:28.365+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:29.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:29.117+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:29.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:29.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:30.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:30.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:30.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:30.397+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:31.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:31.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:31.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:31.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:32.059 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:32.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:32.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:32.413+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:33.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:33.049+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:33.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:33.405+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:34.020 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:34.017+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:34.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:34.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:35.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:35.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:35.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:35.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:36.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:36.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:36.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:36.341+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:37.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:37.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:37.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:37.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:38.142 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:38.141+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:38.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:38.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:39.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:39.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:39.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:39.364+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:40.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:40.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:40.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:40.368+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:41.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:41.220+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:41.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:41.376+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:42.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:42.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:42.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:42.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:43.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:43.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:43.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:43.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:44.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:44.232+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:44.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:44.472+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:45.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:45.200+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:45.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:45.480+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:46.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:46.168+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:46.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:46.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:47.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:47.156+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:47.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:47.476+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:48.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:48.152+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:48.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:48.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:49.132 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:49.128+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:49.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:49.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:50.128 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:50.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:50.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:50.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:51.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:51.092+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:51.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:51.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:52.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:52.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:52.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:52.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:53.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:53.136+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:53.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:53.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:54.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:54.164+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:54.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:54.468+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:55.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:55.128+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:55.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:55.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:56.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:56.084+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:56.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:56.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:57.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:57.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:57.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:57.412+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:58.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:58.084+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:58.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:58.444+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:59.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:55:59.048+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:55:59.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:55:59.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:00.007 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:00.004+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:00.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:00.492+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:00.977 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:00.972+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:01.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:01.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:02.011 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:02.008+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:02.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:02.524+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:03.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:03.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:03.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:03.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:04.064 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:04.060+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:04.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:04.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:05.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:05.040+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:05.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:05.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:06.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:06.024+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:06.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:06.556+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:07.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:07.036+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:07.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:07.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:08.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:08.000+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:08.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:08.516+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:09.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:09.048+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:09.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:09.536+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:10.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:10.036+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:10.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:10.504+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:11.009 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:11.004+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:11.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:11.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:11.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:11.968+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:12.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:12.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:12.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:12.956+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:13.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:13.496+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:13.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:13.908+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:14.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:14.468+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:14.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:14.904+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:15.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:15.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:15.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:15.876+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:16.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:16.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:16.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:16.904+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:17.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:17.468+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:17.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:17.888+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:18.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:18.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:18.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:18.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:19.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:19.380+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:19.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:19.856+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:20.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:20.412+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:20.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:20.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:21.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:21.364+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:21.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:21.900+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:22.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:22.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:22.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:22.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:23.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:23.355+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:23.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:23.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:24.347 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:24.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:24.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:24.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:25.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:25.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:25.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:25.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:26.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:26.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:26.928 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:26.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:27.347 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:27.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:27.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:27.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:28.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:28.327+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:28.890 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:28.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:29.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:29.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:29.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:29.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:30.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:30.367+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:30.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:30.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:31.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:31.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:31.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:31.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:32.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:32.363+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:32.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:32.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:33.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:33.355+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:33.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:33.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:34.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:34.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:34.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:34.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:35.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:35.355+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:35.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:35.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:36.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:36.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:36.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:36.919+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:37.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:37.367+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:37.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:37.883+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:38.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:38.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:38.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:38.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:39.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:39.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:39.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:39.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:40.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:40.431+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:40.989 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:40.983+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:41.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:41.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:42.015 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:42.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:42.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:42.407+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:43.041 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:43.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:43.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:43.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:44.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:44.075+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:44.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:44.347+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:45.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:45.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:45.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:45.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:46.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:46.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:46.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:46.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:47.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:47.091+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:47.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:47.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:48.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:48.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:48.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:48.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:49.149 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:49.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:49.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:49.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:50.124 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:50.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:50.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:50.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:51.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:51.171+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:51.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:51.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:52.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:52.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:52.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:52.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:53.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:53.207+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:53.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:53.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:54.178 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:54.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:54.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:54.319+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:55.200 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:55.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:55.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:55.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:56.247 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:56.243+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:56.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:56.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:57.247 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:57.243+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:57.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:57.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:58.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:58.199+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:58.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:58.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:59.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:56:59.227+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:56:59.303 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:56:59.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:00.188 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:00.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:00.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:00.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:01.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:01.207+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:01.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:01.339+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:02.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:02.227+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:02.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:02.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:03.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:03.247+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:03.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:03.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:04.264 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:04.259+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:04.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:04.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:05.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:05.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:05.278 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:05.275+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:06.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:06.235+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:06.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:06.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:07.218 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:07.215+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:07.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:07.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:08.232 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:08.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:08.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:08.266+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:09.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:09.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:09.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:09.258+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:10.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:10.174+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:10.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:10.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:11.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:11.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:11.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:11.222+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:12.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:12.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:12.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:12.266+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:13.223 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:13.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:13.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:13.306+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:14.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:14.254+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:14.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:14.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:15.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:15.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:15.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:15.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:16.335 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:16.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:16.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:16.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:17.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:17.314+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:17.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:17.362+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:18.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:18.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:18.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:18.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:19.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:19.246+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:19.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:19.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:20.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:20.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:20.463 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:20.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:21.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:21.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:21.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:21.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:22.267 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:22.262+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:22.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:22.490+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:23.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:23.258+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:23.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:23.514+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:24.219 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:24.214+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:24.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:24.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:25.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:25.262+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:25.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:25.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:26.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:26.238+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:26.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:26.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:27.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:27.250+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:27.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:27.478+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:28.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:28.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:28.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:28.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:29.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:29.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:29.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:29.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:30.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:30.178+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:30.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:30.478+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:31.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:31.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:31.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:31.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:32.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:32.246+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:32.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:32.490+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:33.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:33.214+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:33.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:33.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:34.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:34.170+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:34.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:34.434+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:35.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:35.170+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:35.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:35.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:36.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:36.158+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:36.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:36.362+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:37.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:37.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:37.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:37.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:38.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:38.162+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:38.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:38.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:39.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:39.154+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:39.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:39.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:40.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:40.194+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:40.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:40.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:41.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:41.190+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:41.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:41.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:42.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:42.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:42.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:42.398+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:43.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:43.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:43.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:43.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:44.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:44.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:44.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:44.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:45.231 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:45.226+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:45.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:45.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:46.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:46.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:46.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:46.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:47.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:47.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:47.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:47.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:48.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:48.326+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:48.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:48.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:49.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:49.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:49.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:49.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:50.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:50.334+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:50.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:50.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:51.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:51.334+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:51.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:51.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:52.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:52.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:52.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:52.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:53.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:53.305+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:53.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:53.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:54.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:54.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:54.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:54.369+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:55.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:55.301+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:55.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:55.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:56.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:56.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:56.381 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:56.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:57.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:57.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:57.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:57.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:58.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:58.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:58.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:58.413+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:59.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:57:59.317+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:57:59.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:57:59.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:00.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:00.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:00.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:00.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:01.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:01.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:01.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:01.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:02.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:02.289+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:02.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:02.445+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:03.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:03.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:03.480 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:03.477+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:04.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:04.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:04.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:04.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:05.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:05.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:05.452 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:05.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:06.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:06.341+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:06.489 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:06.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:07.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:07.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:07.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:07.489+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:08.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:08.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:08.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:08.469+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:09.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:09.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:09.489 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:09.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:10.349 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:10.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:10.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:10.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:11.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:11.313+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:11.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:11.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:12.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:12.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:12.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:12.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:13.286 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:13.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:13.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:13.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:14.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:14.289+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:14.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:14.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:15.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:15.281+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:15.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:15.585+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:16.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:16.305+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:16.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:16.581+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:17.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:17.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:17.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:17.553+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:18.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:18.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:18.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:18.561+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:19.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:19.289+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:19.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:19.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:20.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:20.281+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:20.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:20.581+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:21.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:21.273+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:21.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:21.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:22.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:22.301+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:22.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:22.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:23.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:23.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:23.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:23.573+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:24.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:24.313+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:24.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:24.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:25.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:25.313+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:25.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:25.553+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:26.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:26.357+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:26.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:26.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:27.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:27.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:27.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:27.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:28.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:28.389+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:28.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:28.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:29.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:29.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:29.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:29.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:30.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:30.441+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:30.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:30.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:31.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:31.425+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:31.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:31.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:32.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:32.457+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:32.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:32.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:33.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:33.473+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:33.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:33.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:34.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:34.497+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:34.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:34.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:35.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:35.493+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:35.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:35.557+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:36.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:36.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:36.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:36.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:37.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:37.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:37.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:37.556+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:38.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:38.476+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:38.525 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:38.520+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:39.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:39.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:39.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:39.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:40.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:40.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:40.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:40.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:41.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:41.440+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:41.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:41.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:42.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:42.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:42.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:42.532+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:43.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:43.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:43.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:43.524+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:44.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:44.424+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:44.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:44.560+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:45.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:45.412+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:45.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:45.604+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:46.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:46.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:46.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:46.628+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:47.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:47.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:47.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:47.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:48.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:48.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:48.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:48.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:49.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:49.392+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:49.677 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:49.672+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:50.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:50.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:50.677 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:50.672+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:51.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:51.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:51.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:51.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:52.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:52.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:52.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:52.712+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:53.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:53.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:53.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:53.744+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:54.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:54.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:54.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:54.728+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:55.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:55.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:55.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:55.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:56.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:56.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:56.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:56.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:57.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:57.516+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:57.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:57.720+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:58.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:58.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:58.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:58.724+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:59.490 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:58:59.488+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:58:59.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:58:59.692+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:00.480 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:00.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:00.730 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:00.728+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:01.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:01.504+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:01.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:01.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:02.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:02.484+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:02.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:02.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:03.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:03.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:03.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:03.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:04.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:04.532+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:04.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:04.724+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:05.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:05.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:05.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:05.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:06.632 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:06.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:06.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:06.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:07.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:07.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:07.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:07.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:08.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:08.616+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:08.696 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:08.692+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:09.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:09.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:09.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:09.684+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:10.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:10.640+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:10.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:10.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:11.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:11.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:11.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:11.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:12.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:12.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:12.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:12.680+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:13.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:13.668+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:13.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:13.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:14.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:14.624+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:14.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:14.656+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:15.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:15.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:15.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:15.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:16.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:16.680+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:16.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:16.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:17.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:17.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:17.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:17.728+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:18.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:18.684+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:18.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:18.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:19.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:19.640+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:19.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:19.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:20.673 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:20.668+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:20.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:20.824+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:21.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:21.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:21.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:21.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:22.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:22.655+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:22.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:22.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:23.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:23.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:23.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:23.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:24.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:24.707+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:24.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:24.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:25.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:25.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:25.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:25.755+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:26.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:26.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:26.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:26.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:27.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:27.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:27.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:27.755+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:28.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:28.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:28.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:28.755+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:29.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:29.683+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:29.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:29.795+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:30.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:30.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:30.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:30.795+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:31.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:31.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:31.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:31.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:32.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:32.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:32.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:32.835+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:33.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:33.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:33.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:33.819+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:34.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:34.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:34.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:34.803+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:35.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:35.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:35.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:35.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:36.810 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:36.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:36.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:36.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:37.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:37.803+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:37.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:37.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:38.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:38.835+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:38.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:38.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:39.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:39.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:39.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:39.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:40.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:40.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:40.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:40.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:41.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:41.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:41.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:41.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:42.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:42.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:42.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:42.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:43.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:43.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:43.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:43.879+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:44.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:44.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:44.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:44.887+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:45.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:45.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:45.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:45.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:46.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:46.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:46.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:46.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:47.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:47.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:47.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:47.939+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:48.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:48.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:48.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:48.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:49.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:49.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:49.900 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:49.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:50.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:50.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:50.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:50.879+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:51.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:51.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:51.860 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:51.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:52.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:52.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:52.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:52.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:53.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:53.715+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:53.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:53.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:54.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:54.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:54.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:54.815+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:55.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:55.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:55.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:55.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:56.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:56.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:56.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:56.787+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:57.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:57.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:57.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:57.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:58.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:58.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:58.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:58.751+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:59.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T08:59:59.735+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T08:59:59.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T08:59:59.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:00.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:00.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:00.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:00.747+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:01.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:01.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:01.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:01.775+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:02.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:02.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:02.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:02.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:03.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:03.775+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:03.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:03.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:04.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:04.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:04.799 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:04.795+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:05.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:05.770+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:05.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:05.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:06.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:06.758+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:06.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:06.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:07.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:07.802+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:07.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:07.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:08.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:08.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:08.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:08.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:09.863 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:09.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:09.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:09.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:10.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:10.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:10.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:10.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:11.853 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:11.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:11.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:11.902+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:12.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:12.862+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:12.897 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:12.890+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:13.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:13.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:13.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:13.886+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:14.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:14.814+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:14.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:14.890+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:15.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:15.818+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:15.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:15.938+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:16.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:16.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:16.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:16.934+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:17.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:17.758+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:17.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:17.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:18.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:18.758+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:19.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:19.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:19.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:19.754+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:20.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:20.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:20.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:20.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:21.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:21.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:21.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:21.782+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:22.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:22.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:22.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:22.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:23.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:23.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:23.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:23.766+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:24.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:24.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:24.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:24.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:25.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:25.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:25.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:25.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:26.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:26.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:26.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:26.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:27.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:26.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:27.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:27.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:27.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:27.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:28.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:28.754+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:29.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:28.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:29.761 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:29.754+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:29.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:29.966+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:30.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:30.754+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:31.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:31.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:31.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:31.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:31.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:31.966+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:32.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:32.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:32.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:32.966+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:33.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:33.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:34.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:34.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:34.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:34.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:34.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:34.974+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:35.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:35.810+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:35.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:35.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:36.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:36.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:37.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:37.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:37.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:37.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:38.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:38.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:38.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:38.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:39.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:39.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:39.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:39.754+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:40.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:40.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:40.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:40.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:41.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:41.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:41.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:41.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:42.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:42.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:42.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:42.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:43.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:43.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:43.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:43.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:43.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:43.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:44.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:44.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:44.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:44.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:45.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:45.886+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:46.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:45.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:46.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:46.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:46.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:46.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:47.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:47.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:48.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:48.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:48.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:48.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:48.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:48.958+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:49.920 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:49.914+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:49.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:49.954+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:50.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:50.881+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:50.915 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:50.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:51.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:51.845+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:51.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:51.933+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:52.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:52.825+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:52.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:52.893+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:53.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:53.825+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:53.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:53.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:54.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:54.793+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:54.883 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:54.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:55.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:55.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:55.927 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:55.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:56.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:56.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:56.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:56.957+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:57.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:57.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:57.985 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:57.981+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:58.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:58.733+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:58.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:00:58.973+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:00:59.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:00:59.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:00.004 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:00.001+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:00.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:00.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:00.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:00.993+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:01.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:01.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:01.971 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:01.969+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:02.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:02.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:02.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:02.977+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:03.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:03.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:03.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:03.945+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:04.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:04.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:04.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:04.981+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:05.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:05.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:05.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:05.949+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:06.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:06.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:06.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:06.981+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:07.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:07.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:07.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:07.969+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:08.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:08.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:08.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:08.961+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:09.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:09.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:09.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:09.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:10.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:10.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:10.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:10.949+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:11.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:11.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:11.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:11.965+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:12.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:12.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:13.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:13.001+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:13.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:13.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:14.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:14.005+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:14.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:14.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:15.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:15.037+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:15.766 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:15.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:16.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:16.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:16.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:16.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:17.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:17.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:17.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:17.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:18.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:18.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:18.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:18.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:19.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:19.129+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:19.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:19.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:20.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:20.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:20.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:20.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:21.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:21.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:21.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:21.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:22.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:22.165+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:22.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:22.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:23.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:23.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:23.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:23.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:24.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:24.133+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:24.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:24.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:25.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:25.157+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:25.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:25.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:26.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:26.149+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:26.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:26.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:27.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:27.121+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:27.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:27.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:28.145 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:28.141+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:28.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:28.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:29.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:29.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:29.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:29.729+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:30.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:30.173+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:30.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:30.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:31.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:31.221+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:31.771 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:31.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:32.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:32.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:32.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:32.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:33.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:33.229+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:33.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:33.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:34.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:34.181+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:34.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:34.828+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:35.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:35.160+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:35.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:35.880+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:36.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:36.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:36.920 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:36.916+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:37.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:37.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:37.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:37.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:38.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:38.112+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:38.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:38.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:39.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:39.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:39.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:39.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:40.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:40.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:40.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:40.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:41.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:41.104+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:41.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:41.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:42.124 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:42.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:43.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:43.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:43.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:43.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:44.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:44.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:44.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:44.092+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:44.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:44.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:45.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:45.056+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:46.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:45.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:46.105 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:46.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:46.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:46.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:47.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:47.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:47.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:47.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:48.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:48.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:48.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:48.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:49.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:49.116+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:49.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:49.976+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:50.149 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:50.144+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:50.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:50.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:51.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:51.196+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:51.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:51.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:52.247 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:52.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:52.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:52.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:53.226 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:53.224+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:53.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:53.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:54.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:54.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:54.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:54.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:55.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:55.224+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:55.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:55.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:56.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:56.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:56.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:56.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:57.207 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:57.204+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:58.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:58.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:58.188 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:58.184+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:59.053 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:01:59.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:01:59.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:01:59.204+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:00.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:00.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:00.218 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:00.216+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:01.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:01.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:01.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:01.264+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:02.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:02.020+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:02.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:02.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:03.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:03.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:03.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:03.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:04.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:04.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:04.243 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:04.240+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:04.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:04.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:05.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:05.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:05.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:05.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:06.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:06.276+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:06.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:06.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:07.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:07.264+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:08.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:08.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:08.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:08.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:09.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:09.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:09.260 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:09.256+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:10.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:10.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:10.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:10.224+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:11.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:11.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:11.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:11.196+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:12.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:12.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:12.170 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:12.168+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:13.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:13.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:13.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:13.200+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:14.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:14.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:14.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:14.160+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:15.102 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:15.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:15.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:15.136+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:16.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:16.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:16.132 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:16.128+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:17.084 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:17.080+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:17.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:17.116+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:18.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:18.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:18.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:18.140+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:19.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:19.056+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:19.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:19.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:20.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:20.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:20.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:20.131+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:21.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:21.067+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:21.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:21.147+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:22.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:22.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:22.122 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:22.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:23.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:23.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:23.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:23.131+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:24.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:24.043+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:24.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:24.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:25.057 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:25.051+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:25.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:25.075+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:26.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:26.015+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:26.111 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:26.107+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:27.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:27.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:27.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:27.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:27.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:27.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:28.091 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:28.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:29.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:29.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:29.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:29.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:30.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:30.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:30.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:30.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:31.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:31.047+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:31.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:31.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:32.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:32.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:32.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:32.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:33.052 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:33.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:33.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:33.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:34.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:34.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:34.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:34.095+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:35.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:35.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:35.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:35.051+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:36.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:36.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:36.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:36.095+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:37.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:37.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:37.111 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:37.107+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:38.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:38.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:38.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:38.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:39.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:39.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:39.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:39.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:40.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:40.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:40.123 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:40.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:41.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:41.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:41.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:41.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:42.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:42.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:42.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:42.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:42.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:42.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:43.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:43.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:43.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:43.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:44.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:44.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:44.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:44.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:45.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:45.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:45.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:45.939+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:46.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:46.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:46.930 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:46.927+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:47.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:47.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:47.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:47.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:48.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:48.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:48.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:48.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:49.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:49.071+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:49.844 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:49.839+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:50.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:50.039+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:50.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:50.859+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:51.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:51.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:51.862 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:51.859+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:51.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:51.983+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:52.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:52.831+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:52.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:52.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:53.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:53.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:53.946 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:53.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:54.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:54.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:54.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:54.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:55.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:55.863+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:55.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:55.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:56.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:56.835+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:56.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:56.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:57.835 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:57.831+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:57.939 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:57.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:58.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:58.859+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:58.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:58.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:59.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:02:59.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:02:59.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:02:59.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:00.844 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:00.839+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:00.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:00.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:01.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:01.835+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:01.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:01.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:02.829 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:02.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:02.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:02.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:03.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:03.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:03.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:03.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:04.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:04.802+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:04.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:04.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:05.786 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:05.782+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:05.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:05.818+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:06.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:06.782+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:06.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:06.782+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:07.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:07.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:07.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:07.794+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:08.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:08.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:08.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:08.802+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:09.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:09.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:09.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:09.794+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:10.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:10.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:10.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:10.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:11.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:11.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:11.863 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:11.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:12.809 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:12.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:12.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:12.826+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:13.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:13.842+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:13.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:13.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:14.891 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:14.886+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:14.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:14.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:15.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:15.922+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:15.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:15.922+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:16.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:16.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:16.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:16.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:17.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:17.862+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:17.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:17.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:18.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:18.818+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:19.022 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:19.014+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:19.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:19.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:20.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:20.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:20.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:20.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:20.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:20.982+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:21.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:21.810+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:22.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:21.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:22.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:22.774+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:23.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:22.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:23.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:23.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:24.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:24.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:24.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:24.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:25.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:25.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:25.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:25.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:26.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:26.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:26.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:26.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:26.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:26.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:27.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:27.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:28.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:28.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:28.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:28.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:29.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:28.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:29.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:29.862+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:30.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:29.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:30.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:30.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:30.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:30.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:31.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:31.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:32.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:32.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:32.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:32.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:33.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:33.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:33.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:33.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:34.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:34.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:34.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:34.906+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:35.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:35.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:35.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:35.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:36.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:35.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:36.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:36.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:37.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:37.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:37.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:37.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:38.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:37.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:38.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:38.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:39.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:38.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:39.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:39.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:39.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:39.958+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:40.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:40.834+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:40.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:40.966+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:41.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:41.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:41.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:41.942+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:42.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:42.814+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:42.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:42.926+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:43.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:43.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:43.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:43.934+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:44.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:44.798+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:44.981 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:44.974+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:45.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:45.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:45.953 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:45.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:46.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:46.798+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:46.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:46.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:47.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:47.766+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:47.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:47.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:48.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:48.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:49.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:48.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:49.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:49.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:50.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:49.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:50.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:50.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:51.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:51.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:51.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:51.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:52.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:52.053+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:52.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:52.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:53.104 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:53.097+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:53.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:53.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:54.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:54.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:54.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:54.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:55.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:55.081+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:55.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:55.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:56.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:56.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:56.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:56.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:57.022 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:57.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:57.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:57.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:58.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:58.073+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:58.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:58.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:59.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:03:59.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:03:59.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:03:59.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:00.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:00.077+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:00.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:00.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:01.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:01.053+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:01.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:01.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:02.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:02.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:02.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:02.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:03.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:03.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:03.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:03.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:03.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:03.961+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:04.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:04.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:05.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:05.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:05.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:05.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:05.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:05.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:06.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:06.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:07.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:07.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:07.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:07.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:08.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:08.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:08.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:08.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:09.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:09.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:09.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:09.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:10.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:10.077+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:10.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:10.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:11.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:11.125+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:11.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:11.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:12.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:12.153+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:12.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:12.765+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:13.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:13.149+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:13.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:13.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:14.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:14.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:14.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:14.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:15.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:15.141+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:15.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:15.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:16.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:16.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:16.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:16.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:17.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:17.221+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:17.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:17.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:18.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:18.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:18.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:18.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:19.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:19.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:19.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:19.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:20.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:20.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:20.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:20.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:21.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:21.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:21.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:21.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:22.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:22.213+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:22.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:22.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:23.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:23.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:23.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:23.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:24.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:24.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:24.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:24.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:25.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:25.273+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:25.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:25.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:26.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:26.261+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:26.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:26.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:27.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:27.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:27.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:27.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:28.223 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:28.221+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:28.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:28.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:29.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:29.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:29.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:29.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:30.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:30.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:30.812 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:30.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:31.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:31.213+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:31.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:31.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:32.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:32.185+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:32.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:32.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:33.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:33.137+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:33.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:33.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:34.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:34.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:34.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:34.800+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:35.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:35.160+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:35.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:35.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:36.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:36.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:36.791 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:36.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:37.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:37.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:37.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:37.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:38.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:38.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:38.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:38.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:39.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:39.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:39.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:39.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:40.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:40.228+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:40.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:40.800+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:41.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:41.264+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:41.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:41.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:42.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:42.264+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:42.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:42.884+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:43.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:43.304+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:43.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:43.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:44.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:44.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:44.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:44.944+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:45.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:45.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:45.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:45.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:46.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:46.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:46.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:46.948+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:47.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:47.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:47.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:47.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:48.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:48.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:48.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:48.892+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:49.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:49.296+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:49.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:49.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:50.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:50.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:50.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:50.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:51.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:51.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:51.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:51.856+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:52.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:52.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:52.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:52.892+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:53.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:53.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:53.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:53.900+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:54.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:54.328+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:54.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:54.872+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:55.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:55.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:55.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:55.860+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:56.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:56.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:56.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:56.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:57.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:57.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:57.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:57.836+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:58.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:58.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:58.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:58.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:59.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:04:59.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:04:59.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:04:59.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:00.397 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:00.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:00.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:00.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:01.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:01.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:01.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:01.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:02.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:02.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:02.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:02.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:03.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:03.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:03.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:03.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:04.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:04.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:04.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:04.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:05.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:05.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:05.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:05.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:06.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:06.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:06.791 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:06.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:07.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:07.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:07.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:07.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:08.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:08.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:08.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:08.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:09.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:09.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:09.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:09.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:10.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:10.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:10.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:10.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:11.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:11.380+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:11.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:11.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:12.347 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:12.344+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:12.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:12.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:13.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:13.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:13.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:13.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:14.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:14.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:14.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:14.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:15.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:15.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:15.880 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:15.876+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:16.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:16.248+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:16.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:16.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:17.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:17.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:17.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:17.824+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:18.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:18.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:18.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:18.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:19.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:19.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:19.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:19.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:20.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:20.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:20.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:20.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:21.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:21.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:21.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:21.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:22.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:22.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:22.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:22.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:23.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:23.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:23.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:23.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:24.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:24.479+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:24.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:24.775+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:25.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:25.519+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:25.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:25.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:26.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:26.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:26.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:26.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:27.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:27.543+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:27.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:27.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:28.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:28.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:28.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:28.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:29.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:29.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:29.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:29.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:30.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:30.487+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:30.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:30.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:31.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:31.455+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:31.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:31.695+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:32.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:32.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:32.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:32.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:33.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:33.487+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:33.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:33.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:34.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:34.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:34.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:34.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:35.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:35.519+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:35.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:35.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:36.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:36.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:36.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:36.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:37.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:37.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:37.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:37.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:38.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:38.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:38.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:38.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:39.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:39.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:39.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:39.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:40.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:40.539+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:40.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:40.875+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:41.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:41.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:41.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:41.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:42.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:42.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:42.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:42.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:43.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:43.487+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:43.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:43.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:44.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:44.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:44.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:44.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:45.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:45.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:45.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:45.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:46.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:46.575+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:46.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:46.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:47.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:47.563+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:47.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:47.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:48.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:48.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:48.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:48.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:49.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:49.599+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:49.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:49.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:50.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:50.563+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:50.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:50.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:51.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:51.583+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:51.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:51.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:52.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:52.587+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:52.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:52.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:53.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:53.567+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:53.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:53.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:54.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:54.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:54.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:54.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:55.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:55.555+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:55.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:55.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:56.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:56.579+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:56.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:56.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:57.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:57.607+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:57.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:57.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:58.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:58.591+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:58.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:58.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:59.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:05:59.559+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:05:59.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:05:59.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:00.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:00.583+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:00.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:00.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:01.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:01.583+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:01.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:01.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:02.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:02.563+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:02.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:02.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:03.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:03.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:03.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:03.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:04.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:04.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:04.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:04.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:05.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:05.690+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:05.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:05.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:06.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:06.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:06.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:06.710+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:07.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:07.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:07.762 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:07.758+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:08.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:08.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:08.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:08.782+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:09.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:09.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:09.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:09.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:10.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:10.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:10.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:10.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:11.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:11.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:11.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:11.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:12.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:12.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:12.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:12.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:13.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:13.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:13.821 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:13.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:14.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:14.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:14.853 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:14.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:15.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:15.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:15.829 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:15.822+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:16.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:16.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:16.866 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:16.862+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:17.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:17.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:17.847 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:17.842+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:18.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:18.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:18.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:18.794+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:19.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:19.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:19.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:19.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:20.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:20.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:20.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:20.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:21.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:21.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:21.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:21.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:22.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:22.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:22.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:22.778+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:23.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:23.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:23.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:23.826+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:24.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:24.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:24.870 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:24.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:25.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:25.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:25.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:25.910+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:26.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:26.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:26.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:26.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:27.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:27.658+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:27.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:27.942+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:28.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:28.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:28.937 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:28.930+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:29.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:29.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:29.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:29.982+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:30.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:30.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:31.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:31.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:31.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:31.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:32.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:32.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:32.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:32.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:33.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:33.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:33.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:33.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:34.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:34.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:34.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:34.666+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:35.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:35.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:35.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:35.662+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:36.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:36.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:36.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:36.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:36.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:36.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:37.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:37.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:38.037 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:38.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:38.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:38.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:39.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:39.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:39.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:39.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:40.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:40.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:40.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:40.666+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:41.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:41.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:41.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:41.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:42.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:42.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:42.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:42.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:42.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:42.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:43.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:43.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:44.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:44.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:44.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:44.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:45.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:45.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:45.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:45.694+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:45.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:45.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:46.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:46.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:46.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:46.934+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:47.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:47.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:47.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:47.898+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:48.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:48.762+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:48.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:48.870+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:49.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:49.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:49.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:49.893+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:50.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:50.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:50.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:50.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:51.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:51.833+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:51.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:51.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:52.857 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:52.849+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:52.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:52.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:53.856 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:53.849+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:53.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:53.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:54.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:54.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:54.968 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:54.961+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:55.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:55.913+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:55.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:55.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:56.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:56.921+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:56.968 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:56.965+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:57.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:57.913+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:57.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:57.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:58.892 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:58.889+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:58.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:58.945+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:59.866 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:06:59.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:06:59.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:06:59.913+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:00.844 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:00.841+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:00.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:00.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:01.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:01.881+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:01.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:01.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:02.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:02.841+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:02.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:02.957+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:03.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:03.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:03.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:03.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:04.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:04.873+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:04.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:04.905+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:05.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:05.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:05.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:05.929+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:06.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:06.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:06.928 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:06.925+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:07.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:07.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:07.931 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:07.929+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:08.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:08.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:08.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:08.973+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:09.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:09.865+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:09.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:09.953+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:10.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:10.893+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:10.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:10.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:11.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:11.861+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:11.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:11.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:12.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:12.913+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:12.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:12.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:13.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:13.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:13.904 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:13.901+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:14.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:14.861+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:14.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:14.905+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:15.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:15.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:15.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:15.889+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:16.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:16.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:16.902 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:16.901+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:17.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:17.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:17.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:17.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:18.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:18.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:18.911 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:18.909+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:19.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:19.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:19.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:19.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:20.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:20.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:20.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:20.961+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:21.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:21.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:21.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:21.973+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:22.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:22.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:22.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:22.989+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:23.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:23.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:23.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:23.945+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:24.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:24.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:24.914 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:24.913+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:25.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:25.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:25.903 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:25.901+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:26.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:26.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:26.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:26.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:27.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:27.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:27.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:27.829+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:28.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:28.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:28.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:28.833+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:29.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:29.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:29.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:29.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:30.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:30.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:30.848 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:30.845+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:31.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:31.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:31.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:31.857+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:32.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:32.765+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:32.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:32.837+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:33.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:33.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:33.892 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:33.889+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:34.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:34.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:34.903 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:34.900+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:35.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:35.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:35.870 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:35.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:36.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:36.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:36.878 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:36.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:37.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:37.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:37.929 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:37.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:38.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:38.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:38.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:38.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:39.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:39.868+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:39.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:39.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:40.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:40.872+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:40.920 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:40.916+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:41.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:41.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:41.937 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:41.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:42.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:42.868+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:42.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:42.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:43.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:43.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:44.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:44.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:44.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:44.912+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:45.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:45.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:45.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:45.892+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:46.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:46.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:46.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:46.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:46.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:46.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:47.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:47.900+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:48.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:48.020+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:48.928 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:48.924+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:48.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:48.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:49.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:49.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:49.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:49.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:50.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:50.892+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:51.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:51.012+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:51.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:51.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:51.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:51.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:52.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:52.968+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:53.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:53.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:53.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:53.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:53.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:53.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:54.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:54.904+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:54.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:54.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:55.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:55.860+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:55.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:55.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:56.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:56.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:56.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:56.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:57.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:57.856+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:57.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:57.976+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:58.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:58.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:58.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:07:58.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:07:59.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:07:59.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:00.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:00.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:00.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:00.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:00.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:00.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:01.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:01.824+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:02.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:02.028+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:02.791 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:02.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:03.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:03.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:03.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:03.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:04.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:04.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:04.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:04.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:05.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:05.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:05.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:05.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:06.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:06.088+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:06.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:06.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:07.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:07.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:07.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:07.716+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:08.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:08.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:08.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:08.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:09.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:09.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:09.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:09.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:10.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:10.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:10.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:10.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:10.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:10.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:11.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:11.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:12.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:12.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:12.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:12.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:12.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:12.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:13.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:13.704+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:13.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:13.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:14.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:14.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:15.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:15.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:15.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:15.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:16.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:16.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:16.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:16.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:16.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:16.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:17.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:17.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:17.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:17.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:18.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:18.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:19.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:19.020+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:19.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:19.616+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:20.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:20.020+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:20.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:20.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:21.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:21.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:21.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:21.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:22.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:22.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:22.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:22.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:23.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:23.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:23.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:23.491+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:24.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:24.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:24.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:24.531+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:25.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:25.071+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:25.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:25.559+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:26.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:26.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:26.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:26.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:27.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:27.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:27.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:27.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:28.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:28.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:28.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:28.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:28.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:28.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:29.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:29.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:30.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:30.011+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:30.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:30.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:30.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:30.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:31.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:31.463+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:31.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:31.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:32.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:32.463+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:32.914 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:32.907+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:33.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:33.447+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:33.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:33.887+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:34.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:34.415+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:34.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:34.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:35.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:35.371+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:35.879 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:35.875+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:36.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:36.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:36.900 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:36.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:37.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:37.403+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:37.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:37.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:38.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:38.431+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:38.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:38.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:39.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:39.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:39.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:39.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:40.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:40.435+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:40.931 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:40.927+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:41.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:41.419+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:41.940 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:41.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:42.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:42.375+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:42.931 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:42.927+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:43.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:43.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:43.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:43.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:44.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:44.431+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:45.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:44.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:45.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:45.395+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:45.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:45.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:46.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:46.363+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:46.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:46.963+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:47.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:47.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:47.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:47.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:48.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:48.375+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:48.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:48.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:49.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:49.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:50.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:50.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:50.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:50.411+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:51.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:51.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:51.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:51.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:52.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:52.095+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:52.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:52.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:53.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:53.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:53.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:53.391+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:54.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:54.051+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:54.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:54.371+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:55.078 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:55.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:55.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:55.339+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:56.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:56.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:56.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:56.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:57.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:57.015+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:57.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:57.347+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:57.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:57.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:58.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:58.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:58.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:58.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:59.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:08:59.431+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:08:59.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:08:59.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:00.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:00.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:00.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:00.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:01.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:01.347+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:01.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:01.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:02.358 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:02.351+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:02.922 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:02.915+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:03.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:03.363+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:03.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:03.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:04.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:04.411+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:04.969 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:04.963+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:05.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:05.419+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:06.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:06.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:06.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:06.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:06.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:06.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:07.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:07.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:07.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:07.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:08.360 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:08.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:08.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:08.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:09.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:09.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:10.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:10.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:10.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:10.310+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:10.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:10.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:11.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:11.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:12.022 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:12.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:12.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:12.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:13.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:13.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:13.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:13.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:14.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:14.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:14.384 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:14.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:15.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:15.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:15.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:15.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:16.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:16.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:16.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:16.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:17.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:17.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:17.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:17.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:18.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:18.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:18.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:18.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:19.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:19.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:19.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:19.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:20.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:20.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:20.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:20.350+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:20.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:20.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:21.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:21.350+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:21.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:21.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:22.309 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:22.302+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:22.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:22.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:23.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:23.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:23.930 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:23.926+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:24.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:24.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:24.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:24.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:25.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:25.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:25.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:25.974+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:26.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:26.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:26.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:26.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:27.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:27.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:28.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:28.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:28.399 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:28.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:29.084 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:29.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:29.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:29.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:30.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:30.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:30.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:30.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:31.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:31.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:31.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:31.386+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:32.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:32.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:32.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:32.434+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:32.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:32.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:33.399 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:33.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:34.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:34.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:34.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:34.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:35.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:35.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:35.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:35.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:35.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:35.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:36.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:36.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:36.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:36.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:37.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:37.534+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:37.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:37.982+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:38.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:38.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:38.940 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:38.934+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:39.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:39.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:39.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:39.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:40.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:40.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:40.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:40.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:41.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:41.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:41.964 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:41.958+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:42.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:42.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:42.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:42.922+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:43.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:43.514+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:43.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:43.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:44.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:44.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:44.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:44.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:45.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:45.538+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:46.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:46.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:46.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:46.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:47.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:47.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:47.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:47.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:48.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:48.062+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:48.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:48.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:49.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:49.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:49.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:49.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:50.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:50.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:50.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:50.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:51.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:51.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:51.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:51.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:52.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:52.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:52.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:52.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:52.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:52.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:53.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:53.581+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:53.982 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:53.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:54.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:54.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:54.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:54.937+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:55.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:55.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:55.964 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:55.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:56.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:56.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:57.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:57.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:57.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:57.657+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:58.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:58.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:58.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:58.709+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:59.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:59.017+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:59.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:09:59.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:09:59.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:09:59.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:00.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:00.709+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:00.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:00.953+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:01.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:01.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:01.911 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:01.909+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:02.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:02.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:02.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:02.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:03.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:03.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:03.911 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:03.909+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:04.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:04.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:04.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:04.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:05.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:05.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:05.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:05.905+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:06.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:06.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:06.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:06.953+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:07.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:07.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:08.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:08.001+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:08.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:08.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:09.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:09.013+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:09.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:09.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:10.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:10.037+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:10.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:10.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:11.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:11.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:11.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:11.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:12.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:12.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:12.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:12.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:13.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:13.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:13.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:13.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:14.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:14.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:14.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:14.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:15.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:15.061+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:15.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:15.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:16.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:16.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:16.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:16.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:17.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:17.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:17.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:17.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:17.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:17.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:18.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:18.685+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:18.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:18.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:19.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:19.665+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:20.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:19.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:20.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:20.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:21.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:21.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:21.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:21.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:22.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:22.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:22.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:22.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:22.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:22.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:23.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:23.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:23.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:23.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:24.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:24.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:24.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:24.949+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:25.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:25.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:25.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:25.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:26.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:26.681+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:26.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:26.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:27.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:27.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:28.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:28.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:28.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:28.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:29.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:29.053+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:29.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:29.657+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:30.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:30.037+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:30.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:30.665+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:30.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:30.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:31.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:31.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:31.969 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:31.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:32.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:32.653+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:33.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:33.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:33.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:33.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:33.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:33.989+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:34.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:34.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:35.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:35.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:35.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:35.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:35.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:35.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:36.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:36.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:36.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:36.952+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:37.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:37.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:37.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:37.976+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:38.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:38.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:38.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:38.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:39.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:39.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:39.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:39.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:40.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:40.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:41.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:41.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:41.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:41.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:42.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:42.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:42.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:42.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:43.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:43.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:43.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:43.656+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:44.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:44.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:44.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:44.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:45.095 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:45.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:45.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:45.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:46.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:46.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:46.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:46.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:47.109 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:47.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:47.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:47.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:48.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:48.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:48.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:48.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:49.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:49.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:49.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:49.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:50.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:50.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:50.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:50.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:51.142 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:51.140+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:51.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:51.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:52.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:52.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:52.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:52.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:53.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:53.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:53.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:53.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:54.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:54.108+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:54.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:54.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:55.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:55.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:55.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:55.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:56.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:56.088+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:56.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:56.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:57.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:57.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:57.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:57.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:58.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:58.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:58.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:58.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:59.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:10:59.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:10:59.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:10:59.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:00.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:00.088+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:00.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:00.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:01.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:01.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:01.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:01.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:02.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:02.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:02.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:02.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:03.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:03.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:03.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:03.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:04.056 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:04.052+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:04.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:04.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:05.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:05.028+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:05.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:05.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:06.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:06.028+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:06.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:06.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:07.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:07.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:07.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:07.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:08.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:08.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:08.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:08.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:09.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:09.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:09.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:09.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:10.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:10.088+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:10.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:10.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:11.137 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:11.132+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:11.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:11.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:12.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:12.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:12.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:12.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:13.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:13.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:13.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:13.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:14.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:14.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:14.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:14.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:15.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:15.184+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:15.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:15.836+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:16.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:16.224+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:16.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:16.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:17.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:17.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:17.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:17.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:18.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:18.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:18.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:18.940+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:19.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:19.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:19.968 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:19.964+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:20.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:20.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:20.985 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:20.980+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:21.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:21.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:21.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:21.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:22.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:22.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:22.939 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:22.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:23.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:23.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:23.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:23.907+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:24.347 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:24.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:24.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:24.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:25.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:25.367+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:25.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:25.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:26.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:26.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:26.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:26.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:27.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:27.411+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:27.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:27.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:28.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:28.411+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:29.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:29.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:29.375 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:29.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:30.012 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:30.007+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:30.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:30.411+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:30.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:30.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:31.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:31.439+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:31.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:31.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:32.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:32.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:32.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:32.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:33.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:33.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:33.973 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:33.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:34.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:34.471+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:34.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:34.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:35.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:35.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:35.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:35.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:36.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:36.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:36.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:36.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:37.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:37.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:37.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:37.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:38.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:38.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:38.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:38.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:39.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:39.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:39.973 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:39.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:40.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:40.447+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:40.955 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:40.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:41.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:41.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:41.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:41.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:42.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:42.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:42.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:42.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:43.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:43.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:43.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:43.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:44.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:44.411+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:44.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:44.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:45.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:45.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:45.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:45.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:46.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:46.387+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:47.017 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:47.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:47.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:47.351+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:48.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:48.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:48.325 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:48.319+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:49.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:49.019+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:49.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:49.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:50.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:50.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:50.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:50.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:51.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:51.051+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:51.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:51.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:52.020 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:52.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:52.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:52.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:53.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:53.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:53.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:53.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:54.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:54.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:54.234 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:54.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:55.020 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:55.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:55.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:55.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:55.997 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:55.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:56.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:56.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:56.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:56.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:57.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:57.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:57.985 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:57.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:58.142 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:58.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:59.030 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:11:59.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:11:59.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:11:59.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:00.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:00.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:00.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:00.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:01.026 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:01.023+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:01.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:01.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:02.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:02.063+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:02.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:02.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:03.020 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:03.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:03.167 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:03.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:04.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:04.039+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:04.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:04.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:04.998 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:04.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:05.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:05.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:06.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:06.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:06.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:06.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:07.052 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:07.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:07.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:07.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:08.096 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:08.090+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:08.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:08.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:09.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:09.134+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:09.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:09.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:10.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:10.090+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:10.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:10.258+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:11.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:11.102+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:11.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:11.290+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:12.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:12.118+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:12.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:12.246+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:13.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:13.094+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:13.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:13.254+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:14.084 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:14.078+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:14.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:14.210+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:15.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:15.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:15.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:15.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:16.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:16.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:16.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:16.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:17.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:17.086+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:17.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:17.190+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:18.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:18.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:18.185 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:18.178+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:19.035 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:19.030+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:19.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:19.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:20.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:20.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:20.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:20.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:21.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:21.022+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:21.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:21.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:22.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:22.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:22.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:22.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:23.011 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:23.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:23.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:23.238+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:24.055 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:24.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:24.280 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:24.274+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:25.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:25.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:25.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:25.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:26.052 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:26.046+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:26.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:26.302+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:27.047 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:27.042+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:27.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:27.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:28.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:28.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:28.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:28.314+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:29.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:29.042+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:29.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:29.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:30.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:30.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:30.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:30.306+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:31.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:31.014+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:31.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:31.306+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:32.012 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:32.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:32.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:32.302+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:32.964 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:32.958+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:33.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:33.258+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:33.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:33.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:34.234 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:34.226+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:34.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:34.950+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:35.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:35.238+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:35.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:35.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:36.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:36.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:36.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:36.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:37.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:37.270+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:37.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:37.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:38.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:38.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:38.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:38.886+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:39.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:39.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:39.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:39.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:40.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:40.254+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:40.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:40.886+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:41.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:41.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:41.880 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:41.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:42.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:42.318+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:42.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:42.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:43.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:43.366+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:43.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:43.818+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:44.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:44.418+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:44.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:44.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:45.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:45.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:45.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:45.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:46.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:46.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:46.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:46.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:47.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:47.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:47.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:47.810+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:48.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:48.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:48.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:48.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:49.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:49.450+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:49.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:49.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:50.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:50.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:50.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:50.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:51.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:51.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:51.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:51.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:52.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:52.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:52.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:52.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:53.480 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:53.473+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:53.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:53.913+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:54.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:54.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:54.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:54.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:55.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:55.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:55.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:55.933+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:56.610 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:56.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:56.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:56.985+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:57.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:57.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:57.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:57.977+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:58.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:58.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:58.945 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:58.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:59.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:12:59.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:12:59.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:12:59.977+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:00.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:00.657+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:00.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:00.973+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:01.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:01.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:01.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:01.977+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:02.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:02.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:03.000 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:02.997+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:03.688 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:03.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:04.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:04.029+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:04.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:04.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:05.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:05.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:05.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:05.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:06.055 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:06.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:06.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:06.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:07.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:07.069+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:07.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:07.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:08.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:08.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:08.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:08.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:09.082 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:09.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:09.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:09.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:10.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:10.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:10.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:10.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:11.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:11.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:11.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:11.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:12.124 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:12.121+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:12.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:12.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:13.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:13.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:13.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:13.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:14.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:14.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:14.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:14.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:15.110 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:15.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:15.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:15.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:16.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:16.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:16.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:16.597+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:17.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:17.125+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:17.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:17.645+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:18.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:18.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:18.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:18.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:19.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:19.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:19.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:19.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:20.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:20.125+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:20.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:20.645+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:21.111 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:21.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:21.664 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:21.661+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:22.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:22.093+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:22.679 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:22.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:23.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:23.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:23.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:23.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:24.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:24.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:24.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:24.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:25.084 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:25.081+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:25.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:25.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:26.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:26.117+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:26.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:26.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:27.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:27.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:27.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:27.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:28.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:28.125+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:28.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:28.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:29.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:29.173+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:29.769 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:29.765+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:30.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:30.197+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:30.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:30.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:31.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:31.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:31.790 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:31.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:32.208 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:32.205+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:32.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:32.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:33.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:33.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:33.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:33.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:34.221 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:34.217+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:34.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:34.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:35.268 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:35.265+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:35.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:35.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:36.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:36.309+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:36.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:36.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:37.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:37.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:37.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:37.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:38.286 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:38.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:38.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:38.732+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:39.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:39.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:39.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:39.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:40.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:40.292+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:40.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:40.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:41.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:41.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:41.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:41.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:42.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:42.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:42.792 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:42.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:43.274 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:43.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:43.805 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:43.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:44.233 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:44.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:44.835 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:44.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:45.220 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:45.216+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:45.879 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:45.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:46.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:46.168+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:46.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:46.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:47.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:47.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:47.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:47.916+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:48.147 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:48.144+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:48.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:48.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:49.177 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:49.172+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:49.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:49.976+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:50.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:50.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:51.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:51.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:51.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:51.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:52.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:52.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:52.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:52.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:53.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:53.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:53.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:53.084+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:54.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:54.072+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:54.099 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:54.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:55.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:55.032+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:55.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:55.112+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:56.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:56.072+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:56.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:56.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:57.056 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:57.052+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:57.110 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:57.108+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:58.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:58.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:58.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:58.148+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:59.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:13:59.020+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:13:59.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:13:59.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:00.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:00.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:00.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:00.152+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:01.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:01.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:01.162 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:01.156+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:01.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:01.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:02.142 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:02.140+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:03.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:03.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:03.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:03.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:04.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:04.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:04.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:04.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:05.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:05.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:05.102 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:05.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:06.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:06.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:06.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:06.064+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:07.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:07.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:07.105 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:07.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:08.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:08.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:08.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:08.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:09.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:09.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:09.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:09.108+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:10.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:10.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:10.162 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:10.160+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:11.138 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:11.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:11.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:11.140+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:12.153 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:12.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:12.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:12.172+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:13.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:13.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:13.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:13.188+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:14.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:14.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:14.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:14.140+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:15.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:15.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:15.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:15.184+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:16.084 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:16.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:16.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:16.168+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:17.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:17.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:17.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:17.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:18.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:18.068+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:18.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:18.140+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:19.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:19.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:19.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:19.140+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:20.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:20.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:20.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:20.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:21.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:21.052+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:21.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:21.104+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:22.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:22.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:22.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:22.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:23.053 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:23.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:23.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:23.116+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:24.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:24.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:24.149 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:24.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:24.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:24.979+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:25.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:25.099+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:25.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:25.975+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:26.149 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:26.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:27.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:26.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:27.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:27.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:27.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:27.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:28.216 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:28.211+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:28.987 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:28.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:29.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:29.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:30.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:29.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:30.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:30.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:31.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:31.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:31.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:31.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:32.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:32.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:32.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:32.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:33.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:33.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:33.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:33.059+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:34.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:33.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:34.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:34.091+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:34.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:34.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:35.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:35.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:36.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:35.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:36.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:36.091+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:37.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:37.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:37.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:37.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:38.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:38.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:38.170 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:38.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:39.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:39.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:39.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:39.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:40.133 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:40.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:40.147 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:40.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:41.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:41.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:41.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:41.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:42.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:42.063+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:42.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:42.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:43.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:43.023+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:43.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:43.071+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:44.030 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:44.023+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:44.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:44.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:45.019 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:45.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:45.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:45.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:46.004 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:45.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:46.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:46.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:47.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:47.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:47.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:47.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:47.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:47.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:48.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:48.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:49.016 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:49.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:49.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:49.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:50.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:50.051+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:50.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:50.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:51.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:51.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:51.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:51.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:52.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:52.051+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:52.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:52.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:53.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:53.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:53.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:53.055+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:54.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:54.015+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:54.096 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:54.091+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:55.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:55.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:55.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:55.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:56.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:56.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:56.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:56.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:57.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:57.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:57.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:57.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:58.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:58.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:58.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:58.155+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:59.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:59.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:59.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:14:59.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:14:59.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:14:59.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:00.196 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:00.191+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:01.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:01.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:01.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:01.239+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:02.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:02.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:02.216 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:02.211+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:03.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:03.071+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:03.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:03.231+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:04.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:04.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:04.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:04.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:05.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:05.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:05.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:05.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:06.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:06.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:06.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:06.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:07.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:07.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:07.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:07.131+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:08.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:08.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:08.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:08.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:09.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:09.090+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:09.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:09.106+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:10.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:10.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:10.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:10.114+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:11.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:11.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:11.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:11.086+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:12.109 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:12.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:12.128 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:12.122+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:13.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:13.150+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:13.177 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:13.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:14.192 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:14.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:14.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:14.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:15.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:15.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:15.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:15.250+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:16.228 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:16.222+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:16.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:16.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:17.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:17.230+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:17.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:17.254+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:18.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:18.210+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:18.225 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:18.218+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:19.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:19.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:19.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:19.238+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:20.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:20.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:20.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:20.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:21.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:21.134+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:21.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:21.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:22.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:22.134+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:22.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:22.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:23.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:23.110+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:23.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:23.190+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:24.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:24.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:24.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:24.210+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:25.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:25.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:25.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:25.162+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:26.062 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:26.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:26.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:26.130+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:27.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:27.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:27.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:27.162+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:28.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:28.094+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:28.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:28.138+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:29.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:29.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:29.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:29.126+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:30.057 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:30.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:30.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:30.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:31.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:31.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:31.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:31.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:31.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:31.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:32.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:32.110+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:33.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:33.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:33.105 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:33.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:34.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:34.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:34.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:34.138+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:35.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:35.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:35.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:35.114+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:36.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:36.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:36.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:36.102+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:36.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:36.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:37.061 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:37.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:37.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:37.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:38.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:38.018+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:38.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:38.930+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:38.990 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:38.986+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:39.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:39.890+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:39.987 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:39.982+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:40.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:40.874+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:40.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:40.934+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:41.880 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:41.874+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:41.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:41.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:42.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:42.838+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:42.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:42.958+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:43.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:43.862+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:43.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:43.966+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:44.903 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:44.898+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:44.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:44.950+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:45.929 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:45.922+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:45.995 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:45.990+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:46.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:46.882+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:47.024 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:47.018+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:47.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:47.870+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:48.012 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:48.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:48.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:48.882+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:48.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:48.958+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:49.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:49.910+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:50.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:50.010+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:50.878 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:50.874+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:50.985 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:50.978+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:51.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:51.902+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:51.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:51.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:52.902 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:52.894+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:52.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:52.970+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:53.878 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:53.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:53.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:53.957+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:54.885 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:54.877+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:54.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:54.917+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:55.912 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:55.905+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:55.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:55.917+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:56.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:56.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:56.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:56.945+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:57.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:57.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:58.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:57.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:58.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:58.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:58.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:58.981+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:59.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:15:59.869+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:15:59.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:15:59.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:00.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:00.865+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:01.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:01.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:01.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:01.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:01.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:01.981+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:02.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:02.861+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:03.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:03.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:03.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:03.873+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:03.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:03.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:04.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:04.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:04.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:04.989+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:05.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:05.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:06.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:06.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:06.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:06.873+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:07.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:07.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:07.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:07.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:08.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:08.061+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:08.945 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:08.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:09.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:09.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:09.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:09.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:10.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:10.073+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:10.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:10.869+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:11.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:11.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:11.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:11.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:12.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:12.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:12.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:12.861+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:13.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:13.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:13.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:13.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:14.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:14.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:14.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:14.861+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:15.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:15.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:15.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:15.873+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:16.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:16.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:16.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:16.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:17.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:17.013+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:17.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:17.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:18.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:18.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:18.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:18.881+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:19.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:19.065+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:19.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:19.889+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:20.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:20.097+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:20.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:20.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:21.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:21.145+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:21.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:21.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:22.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:22.113+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:22.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:22.889+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:23.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:23.161+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:23.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:23.885+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:24.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:24.117+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:24.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:24.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:25.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:25.069+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:25.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:25.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:26.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:26.081+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:26.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:26.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:27.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:27.117+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:27.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:27.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:28.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:28.097+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:28.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:28.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:29.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:29.061+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:29.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:29.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:30.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:30.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:30.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:30.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:31.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:31.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:31.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:31.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:32.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:32.069+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:32.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:32.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:33.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:33.097+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:33.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:33.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:34.137 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:34.133+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:34.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:34.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:35.095 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:35.093+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:35.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:35.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:36.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:36.049+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:36.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:36.869+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:37.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:37.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:37.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:37.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:37.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:37.973+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:38.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:38.869+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:38.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:38.981+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:39.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:39.876+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:39.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:39.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:40.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:40.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:40.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:40.928+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:41.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:41.936+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:41.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:41.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:42.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:42.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:42.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:42.948+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:43.955 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:43.952+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:43.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:43.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:44.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:44.936+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:44.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:44.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:45.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:45.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:45.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:45.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:46.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:46.884+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:46.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:46.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:47.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:47.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:48.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:47.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:48.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:48.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:49.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:49.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:49.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:49.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:49.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:49.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:50.812 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:50.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:50.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:50.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:51.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:51.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:52.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:51.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:52.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:52.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:53.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:53.012+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:53.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:53.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:53.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:53.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:54.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:54.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:54.940 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:54.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:55.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:55.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:55.895 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:55.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:56.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:56.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:56.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:56.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:57.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:57.860+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:57.929 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:57.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:58.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:58.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:58.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:58.940+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:59.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:16:59.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:16:59.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:16:59.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:00.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:00.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:00.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:00.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:01.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:01.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:01.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:01.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:02.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:02.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:02.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:02.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:03.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:03.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:03.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:03.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:04.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:04.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:04.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:04.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:05.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:05.836+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:05.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:05.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:06.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:06.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:06.937 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:06.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:07.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:07.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:07.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:07.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:08.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:08.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:08.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:08.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:09.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:09.888+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:10.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:10.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:10.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:10.884+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:11.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:11.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:11.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:11.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:12.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:12.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:12.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:12.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:13.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:13.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:13.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:13.936+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:14.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:14.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:14.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:14.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:15.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:15.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:15.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:15.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:16.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:16.088+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:16.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:16.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:17.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:17.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:17.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:17.964+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:18.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:18.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:18.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:18.964+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:19.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:19.072+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:19.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:19.968+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:20.037 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:20.032+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:20.977 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:20.972+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:20.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:20.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:21.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:21.924+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:22.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:22.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:22.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:22.944+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:23.084 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:23.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:23.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:23.956+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:24.132 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:24.128+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:24.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:24.911+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:25.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:25.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:25.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:25.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:26.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:26.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:26.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:26.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:27.191 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:27.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:27.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:27.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:28.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:28.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:28.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:28.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:29.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:29.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:29.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:29.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:30.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:30.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:30.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:30.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:31.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:31.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:31.993 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:31.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:32.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:32.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:32.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:32.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:33.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:33.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:33.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:33.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:34.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:34.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:35.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:34.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:35.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:35.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:36.043 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:36.039+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:36.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:36.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:37.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:37.059+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:37.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:37.327+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:38.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:38.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:38.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:38.327+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:38.989 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:38.983+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:39.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:39.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:40.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:40.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:40.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:40.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:41.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:40.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:41.347 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:41.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:42.047 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:42.043+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:42.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:42.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:43.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:43.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:43.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:43.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:44.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:44.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:44.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:44.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:45.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:45.051+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:45.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:45.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:46.059 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:46.055+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:46.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:46.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:47.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:47.023+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:47.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:47.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:48.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:48.043+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:48.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:48.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:49.009 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:49.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:49.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:49.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:50.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:50.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:50.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:50.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:51.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:51.031+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:51.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:51.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:51.991 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:51.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:52.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:52.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:52.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:52.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:53.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:53.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:53.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:53.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:54.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:54.215+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:54.999 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:54.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:55.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:55.179+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:56.000 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:55.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:56.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:56.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:57.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:57.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:57.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:57.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:58.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:58.031+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:58.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:58.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:58.995 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:17:58.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:17:59.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:17:59.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:00.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:00.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:00.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:00.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:00.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:00.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:01.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:01.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:01.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:01.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:02.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:02.051+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:02.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:02.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:03.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:03.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:03.993 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:03.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:04.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:04.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:04.964 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:04.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:04.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:04.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:05.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:05.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:06.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:06.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:06.983 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:06.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:07.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:07.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:07.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:07.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:08.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:08.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:08.991 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:08.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:09.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:09.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:09.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:09.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:10.004 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:09.998+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:10.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:10.962+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:11.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:11.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:11.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:11.930+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:12.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:12.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:12.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:12.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:13.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:13.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:13.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:13.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:14.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:14.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:14.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:14.938+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:15.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:15.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:15.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:15.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:16.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:16.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:16.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:16.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:17.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:17.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:17.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:17.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:18.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:18.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:18.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:18.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:19.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:19.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:19.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:19.854+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:20.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:20.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:20.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:20.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:21.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:21.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:21.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:21.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:22.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:22.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:22.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:22.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:23.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:23.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:23.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:23.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:24.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:24.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:24.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:24.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:24.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:24.974+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:25.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:25.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:25.987 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:25.982+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:26.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:26.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:27.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:27.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:27.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:27.862+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:28.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:28.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:28.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:28.886+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:29.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:29.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:29.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:29.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:30.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:30.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:30.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:30.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:30.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:30.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:31.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:31.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:31.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:31.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:32.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:32.886+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:32.953 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:32.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:33.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:33.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:33.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:33.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:34.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:34.902+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:35.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:35.014+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:35.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:35.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:36.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:36.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:36.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:36.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:37.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:37.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:37.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:37.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:38.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:38.106+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:38.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:38.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:39.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:39.114+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:39.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:39.954+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:40.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:40.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:40.989 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:40.982+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:41.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:41.114+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:42.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:42.030+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:42.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:42.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:43.000 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:42.994+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:43.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:43.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:44.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:44.018+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:44.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:44.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:45.024 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:45.018+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:45.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:45.106+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:45.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:45.978+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:46.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:46.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:46.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:46.990+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:47.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:47.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:48.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:48.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:48.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:48.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:49.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:49.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:49.048 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:49.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:50.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:50.038+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:50.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:50.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:50.999 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:50.994+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:51.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:51.106+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:51.995 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:51.990+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:52.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:52.058+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:52.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:52.986+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:53.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:53.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:54.011 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:54.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:54.102 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:54.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:55.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:55.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:55.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:55.121+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:56.001 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:55.993+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:56.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:56.121+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:57.001 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:56.993+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:57.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:57.073+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:58.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:58.037+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:58.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:58.093+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:59.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:18:59.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:18:59.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:18:59.101+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:00.017 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:00.009+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:00.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:00.069+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:01.059 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:01.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:01.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:01.073+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:02.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:02.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:02.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:02.053+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:03.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:03.053+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:03.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:03.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:04.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:04.069+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:04.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:04.089+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:05.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:05.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:05.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:05.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:06.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:06.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:06.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:06.029+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:07.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:07.061+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:07.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:07.061+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:08.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:08.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:08.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:08.101+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:08.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:08.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:09.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:09.129+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:09.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:09.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:10.099 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:10.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:10.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:10.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:11.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:11.129+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:12.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:12.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:12.180 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:12.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:13.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:13.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:13.145 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:13.141+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:13.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:13.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:14.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:14.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:14.987 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:14.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:15.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:15.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:16.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:16.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:16.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:16.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:17.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:17.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:17.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:17.037+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:18.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:18.069+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:18.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:18.089+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:19.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:19.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:19.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:19.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:20.025 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:20.021+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:20.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:20.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:21.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:21.053+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:21.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:21.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:22.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:22.057+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:22.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:22.081+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:23.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:23.065+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:23.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:23.089+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:24.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:24.057+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:24.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:24.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:25.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:25.057+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:25.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:25.089+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:26.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:26.017+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:26.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:26.117+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:27.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:26.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:27.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:27.125+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:27.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:27.961+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:28.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:28.093+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:28.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:28.989+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:29.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:29.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:29.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:29.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:30.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:30.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:30.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:30.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:31.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:31.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:31.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:31.921+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:32.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:32.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:32.891 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:32.889+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:33.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:33.069+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:33.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:33.921+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:34.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:34.089+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:34.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:34.917+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:35.055 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:35.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:35.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:35.953+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:36.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:36.037+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:36.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:36.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:37.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:37.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:38.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:38.001+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:38.012 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:38.009+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:39.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:39.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:39.011 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:39.009+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:39.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:39.961+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:40.047 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:40.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:40.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:40.920+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:41.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:41.032+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:41.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:41.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:42.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:42.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:42.900 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:42.896+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:43.096 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:43.092+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:43.900 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:43.896+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:44.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:44.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:44.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:44.900+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:45.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:45.056+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:45.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:45.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:46.017 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:46.012+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:46.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:46.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:47.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:47.064+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:47.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:47.976+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:48.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:48.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:48.937 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:48.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:49.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:49.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:49.908 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:49.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:50.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:50.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:50.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:50.868+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:51.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:51.056+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:51.870 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:51.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:52.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:52.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:52.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:52.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:53.102 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:53.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:53.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:53.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:54.091 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:54.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:54.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:54.880+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:55.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:55.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:55.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:55.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:56.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:56.060+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:56.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:56.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:57.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:57.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:57.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:57.912+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:58.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:58.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:58.915 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:58.912+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:59.128 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:19:59.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:19:59.913 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:19:59.908+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:00.170 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:00.164+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:00.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:00.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:01.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:01.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:01.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:01.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:02.215 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:02.212+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:03.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:03.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:03.194 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:03.188+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:04.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:04.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:04.185 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:04.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:05.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:05.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:05.210 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:05.204+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:06.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:06.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:06.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:06.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:06.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:06.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:07.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:07.192+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:07.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:07.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:08.221 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:08.216+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:09.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:09.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:09.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:09.216+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:09.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:09.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:10.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:10.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:10.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:10.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:11.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:11.276+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:11.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:11.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:12.248 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:12.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:12.910 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:12.908+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:13.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:13.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:13.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:13.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:14.226 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:14.224+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:14.957 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:14.952+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:15.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:15.176+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:16.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:16.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:16.214 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:16.208+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:16.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:16.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:17.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:17.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:18.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:18.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:18.256 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:18.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:18.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:18.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:19.232 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:19.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:19.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:19.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:20.225 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:20.220+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:20.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:20.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:21.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:21.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:21.946 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:21.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:22.256 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:22.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:22.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:22.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:23.259 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:23.256+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:23.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:23.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:24.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:24.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:24.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:24.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:25.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:25.259+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:25.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:25.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:26.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:26.263+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:26.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:26.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:27.233 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:27.227+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:27.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:27.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:28.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:28.247+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:28.953 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:28.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:29.235 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:29.231+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:29.956 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:29.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:30.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:30.239+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:30.913 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:30.907+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:31.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:31.191+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:31.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:31.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:32.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:32.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:32.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:32.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:33.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:33.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:33.982 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:33.975+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:34.177 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:34.171+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:35.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:35.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:35.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:35.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:36.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:36.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:36.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:36.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:37.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:37.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:37.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:37.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:38.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:38.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:38.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:38.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:39.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:39.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:39.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:39.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:40.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:40.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:40.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:40.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:41.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:41.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:41.161 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:41.155+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:42.123 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:42.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:42.153 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:42.147+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:43.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:43.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:43.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:43.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:44.159 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:44.155+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:44.167 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:44.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:45.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:45.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:45.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:45.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:46.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:46.131+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:46.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:46.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:47.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:47.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:47.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:47.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:48.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:48.047+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:48.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:48.203+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:49.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:49.011+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:49.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:49.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:49.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:49.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:50.213 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:50.207+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:51.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:51.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:51.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:51.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:52.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:52.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:52.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:52.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:53.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:53.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:53.186 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:53.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:54.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:54.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:54.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:54.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:55.084 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:55.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:55.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:55.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:56.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:56.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:56.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:56.095+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:57.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:57.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:57.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:57.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:58.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:57.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:58.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:58.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:58.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:58.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:20:59.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:20:59.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:00.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:20:59.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:00.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:00.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:01.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:01.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:01.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:01.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:02.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:02.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:02.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:02.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:03.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:03.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:03.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:03.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:04.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:04.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:04.133 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:04.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:05.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:05.079+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:05.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:05.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:06.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:06.043+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:06.166 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:06.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:07.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:07.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:07.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:07.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:08.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:08.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:08.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:08.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:09.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:09.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:09.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:09.203+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:10.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:10.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:10.184 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:10.179+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:11.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:10.998+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:11.234 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:11.226+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:12.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:12.018+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:12.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:12.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:13.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:13.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:13.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:13.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:14.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:14.062+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:14.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:14.174+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:15.085 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:15.078+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:15.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:15.158+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:16.041 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:16.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:16.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:16.174+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:17.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:17.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:17.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:17.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:18.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:18.074+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:18.164 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:18.158+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:19.041 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:19.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:19.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:19.122+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:20.019 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:20.014+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:20.166 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:20.158+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:21.011 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:21.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:21.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:21.210+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:22.013 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:22.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:22.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:22.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:23.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:23.022+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:23.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:23.178+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:24.000 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:23.994+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:24.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:24.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:25.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:25.038+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:25.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:25.162+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:26.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:26.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:26.187 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:26.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:27.110 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:27.102+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:27.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:27.146+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:28.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:28.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:28.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:28.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:29.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:29.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:29.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:29.150+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:30.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:30.062+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:30.196 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:30.190+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:31.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:31.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:31.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:31.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:32.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:31.998+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:32.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:32.170+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:33.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:33.022+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:33.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:33.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:34.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:34.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:34.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:34.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:35.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:35.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:35.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:35.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:36.036 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:36.030+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:36.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:36.194+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:37.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:37.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:37.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:37.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:38.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:38.074+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:38.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:38.210+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:39.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:39.118+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:39.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:39.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:40.082 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:40.074+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:40.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:40.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:41.047 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:41.042+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:41.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:41.318+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:42.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:42.038+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:42.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:42.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:43.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:42.998+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:43.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:43.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:44.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:44.038+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:44.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:44.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:45.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:45.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:45.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:45.318+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:46.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:46.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:46.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:46.354+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:47.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:47.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:47.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:47.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:48.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:48.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:48.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:48.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:49.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:49.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:49.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:49.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:50.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:50.062+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:50.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:50.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:51.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:51.038+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:51.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:51.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:52.054 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:52.046+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:52.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:52.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:53.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:53.030+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:53.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:53.390+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:54.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:54.038+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:54.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:54.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:55.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:55.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:55.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:55.450+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:56.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:56.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:56.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:56.473+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:57.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:57.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:57.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:57.497+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:58.166 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:58.157+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:58.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:58.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:59.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:21:59.189+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:21:59.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:21:59.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:00.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:00.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:00.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:00.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:01.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:01.189+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:01.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:01.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:02.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:02.233+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:02.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:02.569+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:03.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:03.237+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:03.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:03.553+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:04.226 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:04.221+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:04.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:04.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:05.268 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:05.265+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:05.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:05.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:06.248 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:06.245+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:06.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:06.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:07.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:07.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:07.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:07.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:08.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:08.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:08.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:08.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:09.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:09.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:09.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:09.421+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:10.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:10.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:10.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:10.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:11.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:11.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:11.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:11.405+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:12.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:12.241+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:12.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:12.397+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:13.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:13.201+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:13.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:13.445+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:14.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:14.169+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:14.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:14.493+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:15.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:15.149+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:15.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:15.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:16.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:16.181+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:16.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:16.489+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:17.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:17.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:17.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:17.469+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:18.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:18.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:18.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:18.437+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:19.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:19.149+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:19.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:19.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:20.146 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:20.141+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:20.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:20.457+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:21.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:21.141+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:21.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:21.489+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:22.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:22.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:22.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:22.529+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:23.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:23.133+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:23.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:23.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:24.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:24.165+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:24.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:24.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:25.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:25.197+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:25.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:25.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:26.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:26.169+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:26.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:26.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:27.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:27.201+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:27.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:27.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:28.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:28.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:28.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:28.465+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:29.146 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:29.141+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:29.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:29.433+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:30.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:30.125+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:30.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:30.485+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:31.178 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:31.173+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:31.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:31.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:32.228 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:32.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:32.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:32.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:33.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:33.185+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:33.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:33.493+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:34.213 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:34.209+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:34.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:34.481+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:35.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:35.185+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:35.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:35.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:36.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:36.229+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:36.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:36.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:37.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:37.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:37.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:37.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:38.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:38.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:38.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:38.493+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:39.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:39.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:39.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:39.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:40.225 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:40.221+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:40.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:40.485+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:41.252 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:41.248+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:41.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:41.440+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:42.232 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:42.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:42.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:42.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:43.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:43.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:43.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:43.476+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:44.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:44.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:44.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:44.480+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:45.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:45.224+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:45.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:45.508+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:46.251 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:46.248+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:46.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:46.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:47.243 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:47.240+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:47.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:47.556+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:48.276 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:48.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:48.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:48.580+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:49.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:49.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:49.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:49.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:50.314 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:50.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:50.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:50.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:51.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:51.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:51.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:51.536+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:52.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:52.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:52.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:52.560+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:53.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:53.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:53.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:53.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:54.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:54.300+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:54.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:54.588+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:55.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:55.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:55.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:55.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:56.252 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:56.248+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:56.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:56.532+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:57.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:57.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:57.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:57.488+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:58.248 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:58.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:58.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:58.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:59.241 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:22:59.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:22:59.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:22:59.480+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:00.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:00.264+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:00.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:00.448+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:01.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:01.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:01.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:01.444+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:02.242 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:02.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:02.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:02.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:03.235 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:03.232+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:03.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:03.504+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:04.245 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:04.240+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:04.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:04.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:05.268 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:05.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:05.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:05.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:06.263 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:06.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:06.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:06.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:07.252 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:07.248+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:07.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:07.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:08.262 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:08.256+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:08.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:08.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:09.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:09.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:09.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:09.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:10.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:10.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:10.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:10.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:11.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:11.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:11.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:11.556+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:12.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:12.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:12.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:12.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:13.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:13.288+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:13.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:13.536+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:14.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:14.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:14.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:14.504+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:15.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:15.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:15.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:15.532+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:16.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:16.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:16.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:16.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:17.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:17.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:17.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:17.544+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:18.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:18.296+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:18.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:18.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:19.264 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:19.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:19.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:19.584+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:20.263 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:20.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:20.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:20.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:21.259 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:21.256+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:21.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:21.492+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:22.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:22.212+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:22.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:22.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:23.178 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:23.172+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:23.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:23.536+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:24.147 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:24.144+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:24.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:24.496+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:25.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:25.172+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:25.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:25.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:26.171 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:26.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:26.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:26.455+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:27.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:27.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:27.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:27.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:28.128 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:28.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:28.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:28.467+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:29.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:29.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:29.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:29.435+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:30.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:30.091+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:30.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:30.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:31.142 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:31.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:31.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:31.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:32.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:32.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:32.397 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:32.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:33.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:33.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:33.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:33.347+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:34.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:34.127+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:34.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:34.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:35.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:35.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:35.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:35.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:36.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:36.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:36.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:36.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:37.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:37.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:37.280 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:37.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:38.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:38.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:38.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:38.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:39.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:39.099+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:39.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:39.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:40.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:40.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:40.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:40.203+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:41.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:41.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:41.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:41.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:42.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:42.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:42.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:42.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:43.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:43.211+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:43.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:43.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:44.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:44.211+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:44.267 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:44.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:45.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:45.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:45.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:45.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:46.218 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:46.211+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:46.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:46.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:47.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:47.259+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:47.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:47.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:48.263 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:48.259+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:48.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:48.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:49.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:49.295+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:49.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:49.423+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:50.260 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:50.255+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:50.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:50.471+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:51.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:51.263+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:51.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:51.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:52.267 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:52.263+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:52.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:52.487+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:53.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:53.307+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:53.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:53.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:54.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:54.299+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:54.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:54.431+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:55.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:55.315+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:55.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:55.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:56.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:56.335+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:56.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:56.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:57.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:57.339+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:57.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:57.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:58.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:58.311+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:58.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:58.411+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:59.335 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:23:59.331+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:23:59.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:23:59.423+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:00.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:00.307+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:00.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:00.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:01.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:01.355+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:01.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:01.447+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:02.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:02.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:02.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:02.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:03.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:03.387+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:03.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:03.455+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:04.360 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:04.355+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:04.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:04.475+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:05.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:05.307+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:05.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:05.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:06.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:06.339+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:06.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:06.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:07.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:07.307+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:07.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:07.487+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:08.297 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:08.291+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:08.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:08.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:09.267 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:09.263+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:09.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:09.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:10.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:10.275+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:10.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:10.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:11.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:11.310+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:11.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:11.522+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:12.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:12.322+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:12.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:12.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:13.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:13.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:13.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:13.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:14.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:14.306+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:14.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:14.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:15.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:15.294+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:15.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:15.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:16.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:16.286+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:16.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:16.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:17.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:17.302+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:17.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:17.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:18.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:18.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:18.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:18.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:19.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:19.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:19.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:19.470+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:20.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:20.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:20.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:20.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:21.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:21.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:21.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:21.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:22.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:22.386+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:22.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:22.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:23.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:23.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:23.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:23.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:24.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:24.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:24.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:24.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:25.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:25.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:25.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:25.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:26.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:26.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:26.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:26.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:27.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:27.350+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:27.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:27.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:28.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:28.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:28.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:28.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:29.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:29.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:29.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:29.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:30.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:30.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:30.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:30.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:31.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:31.366+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:31.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:31.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:32.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:32.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:32.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:32.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:33.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:33.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:33.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:33.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:34.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:34.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:34.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:34.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:35.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:35.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:35.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:35.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:36.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:36.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:36.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:36.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:37.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:37.470+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:37.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:37.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:38.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:38.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:38.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:38.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:39.460 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:39.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:39.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:39.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:40.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:40.490+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:40.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:40.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:41.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:41.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:41.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:41.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:42.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:42.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:42.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:42.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:43.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:43.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:43.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:43.458+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:44.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:44.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:44.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:44.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:45.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:45.474+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:45.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:45.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:46.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:46.434+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:46.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:46.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:47.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:47.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:47.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:47.538+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:48.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:48.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:48.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:48.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:49.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:49.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:49.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:49.578+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:50.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:50.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:50.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:50.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:51.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:51.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:51.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:51.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:52.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:52.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:52.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:52.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:53.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:53.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:53.547 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:53.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:54.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:54.470+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:54.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:54.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:55.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:55.518+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:55.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:55.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:56.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:56.545+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:56.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:56.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:57.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:57.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:57.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:57.569+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:58.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:58.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:58.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:58.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:59.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:24:59.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:24:59.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:24:59.585+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:00.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:00.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:00.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:00.557+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:01.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:01.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:01.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:01.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:02.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:02.569+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:02.583 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:02.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:03.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:03.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:03.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:03.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:04.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:04.561+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:04.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:04.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:05.597 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:05.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:05.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:05.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:06.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:06.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:06.676 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:06.673+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:07.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:07.589+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:07.670 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:07.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:08.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:08.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:08.698 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:08.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:09.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:09.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:09.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:09.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:10.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:10.569+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:10.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:10.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:11.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:11.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:11.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:11.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:12.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:12.497+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:12.744 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:12.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:13.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:13.469+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:13.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:13.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:14.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:14.481+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:14.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:14.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:15.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:15.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:15.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:15.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:16.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:16.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:16.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:16.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:17.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:17.501+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:17.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:17.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:18.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:18.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:18.725 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:18.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:19.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:19.573+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:19.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:19.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:20.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:20.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:20.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:20.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:21.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:21.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:21.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:21.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:22.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:22.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:22.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:22.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:23.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:23.681+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:23.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:23.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:24.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:24.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:24.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:24.733+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:25.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:25.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:25.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:25.733+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:26.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:26.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:26.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:26.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:27.744 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:27.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:27.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:27.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:28.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:28.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:28.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:28.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:29.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:29.729+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:29.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:29.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:30.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:30.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:30.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:30.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:31.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:31.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:31.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:31.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:32.688 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:32.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:32.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:32.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:33.725 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:33.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:33.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:33.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:34.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:34.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:34.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:34.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:35.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:35.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:35.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:35.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:36.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:36.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:36.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:36.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:37.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:37.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:37.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:37.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:38.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:38.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:38.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:38.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:39.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:39.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:39.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:39.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:40.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:40.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:40.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:40.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:41.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:41.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:41.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:41.732+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:42.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:42.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:42.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:42.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:43.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:43.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:43.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:43.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:44.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:44.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:44.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:44.828+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:45.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:45.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:45.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:45.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:46.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:46.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:46.904 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:46.900+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:47.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:47.716+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:47.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:47.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:48.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:48.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:48.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:48.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:49.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:49.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:49.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:49.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:50.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:50.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:50.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:50.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:51.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:51.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:51.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:51.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:52.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:52.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:52.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:52.880+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:53.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:53.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:53.912 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:53.908+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:54.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:54.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:54.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:54.916+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:55.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:55.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:55.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:55.920+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:56.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:56.716+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:56.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:56.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:57.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:57.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:57.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:57.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:58.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:58.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:58.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:25:58.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:25:59.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:25:59.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:00.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:00.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:00.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:00.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:00.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:00.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:01.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:01.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:02.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:01.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:02.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:02.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:02.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:02.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:03.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:03.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:03.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:03.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:04.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:04.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:05.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:05.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:05.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:05.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:05.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:05.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:06.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:06.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:07.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:07.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:07.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:07.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:07.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:07.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:08.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:08.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:08.930 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:08.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:09.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:09.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:09.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:09.940+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:10.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:10.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:10.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:10.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:11.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:11.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:11.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:11.920+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:12.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:12.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:12.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:12.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:13.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:13.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:13.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:13.928+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:14.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:14.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:14.912 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:14.908+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:15.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:15.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:15.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:15.912+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:16.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:16.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:16.895 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:16.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:17.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:17.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:17.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:17.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:18.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:18.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:18.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:18.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:19.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:19.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:20.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:20.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:20.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:20.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:21.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:21.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:21.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:21.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:21.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:21.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:22.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:22.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:22.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:22.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:23.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:23.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:24.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:23.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:24.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:24.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:24.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:24.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:25.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:25.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:25.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:25.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:26.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:26.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:26.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:26.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:27.727 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:27.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:28.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:28.015+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:28.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:28.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:29.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:29.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:29.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:29.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:30.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:30.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:30.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:30.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:31.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:31.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:31.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:31.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:32.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:32.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:32.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:32.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:33.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:33.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:33.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:33.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:34.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:34.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:34.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:34.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:35.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:34.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:35.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:35.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:35.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:35.975+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:36.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:36.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:36.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:36.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:37.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:37.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:37.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:37.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:38.828 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:38.823+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:39.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:39.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:39.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:39.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:39.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:39.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:40.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:40.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:41.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:40.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:41.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:41.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:41.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:41.963+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:42.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:42.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:42.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:42.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:43.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:43.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:43.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:43.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:44.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:44.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:44.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:44.959+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:45.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:45.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:45.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:45.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:46.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:46.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:46.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:46.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:47.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:47.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:48.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:48.019+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:48.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:48.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:49.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:48.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:49.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:49.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:49.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:49.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:50.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:50.715+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:50.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:50.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:51.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:51.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:51.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:51.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:52.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:52.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:52.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:52.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:53.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:53.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:53.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:53.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:54.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:54.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:54.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:54.927+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:55.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:55.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:55.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:55.959+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:56.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:56.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:56.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:56.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:57.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:57.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:57.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:57.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:58.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:58.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:58.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:58.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:59.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:26:59.471+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:26:59.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:26:59.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:00.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:00.451+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:00.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:00.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:01.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:01.427+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:01.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:01.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:02.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:02.451+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:02.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:02.927+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:03.470 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:03.463+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:03.930 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:03.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:04.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:04.423+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:04.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:04.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:05.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:05.443+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:05.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:05.903+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:06.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:06.435+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:06.910 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:06.903+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:07.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:07.439+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:07.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:07.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:08.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:08.491+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:08.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:08.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:09.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:09.535+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:09.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:09.979+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:10.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:10.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:10.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:10.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:11.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:11.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:12.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:12.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:12.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:12.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:13.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:13.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:13.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:13.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:14.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:14.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:14.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:14.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:15.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:15.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:15.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:15.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:16.102 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:16.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:16.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:16.614+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:17.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:17.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:17.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:17.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:18.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:18.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:18.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:18.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:19.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:19.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:19.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:19.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:20.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:20.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:20.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:20.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:21.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:21.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:21.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:21.518+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:22.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:22.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:22.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:22.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:23.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:23.014+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:23.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:23.466+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:23.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:23.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:24.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:24.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:25.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:25.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:25.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:25.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:26.053 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:26.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:26.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:26.446+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:27.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:27.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:27.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:27.438+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:28.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:28.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:28.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:28.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:29.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:29.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:29.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:29.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:30.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:30.058+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:30.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:30.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:31.057 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:31.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:31.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:31.434+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:32.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:32.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:32.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:32.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:33.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:33.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:33.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:33.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:34.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:34.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:34.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:34.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:35.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:35.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:35.460 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:35.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:36.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:36.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:36.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:36.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:37.053 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:37.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:37.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:37.494+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:38.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:38.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:38.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:38.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:39.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:39.058+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:39.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:39.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:40.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:40.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:40.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:40.490+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:41.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:41.098+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:41.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:41.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:42.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:42.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:42.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:42.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:43.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:43.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:43.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:43.558+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:44.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:44.086+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:44.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:44.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:45.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:45.058+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:45.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:45.558+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:46.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:46.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:46.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:46.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:47.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:47.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:47.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:47.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:48.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:48.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:48.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:48.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:49.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:49.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:49.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:49.614+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:50.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:50.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:50.645 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:50.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:51.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:51.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:51.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:51.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:52.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:52.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:52.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:52.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:53.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:53.118+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:53.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:53.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:54.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:54.138+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:54.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:54.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:55.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:55.114+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:55.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:55.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:56.132 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:56.126+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:56.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:56.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:57.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:57.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:57.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:57.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:58.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:58.145+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:58.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:58.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:59.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:27:59.113+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:27:59.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:27:59.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:00.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:00.137+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:00.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:00.605+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:01.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:01.145+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:01.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:01.649+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:02.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:02.141+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:02.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:02.653+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:03.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:03.173+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:03.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:03.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:04.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:04.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:04.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:04.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:05.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:05.217+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:05.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:05.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:06.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:06.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:06.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:06.605+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:07.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:07.257+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:07.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:07.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:08.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:08.273+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:08.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:08.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:09.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:09.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:09.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:09.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:10.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:10.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:10.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:10.665+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:11.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:11.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:11.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:11.661+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:12.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:12.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:12.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:12.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:13.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:13.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:13.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:13.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:14.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:14.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:14.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:14.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:15.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:15.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:15.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:15.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:16.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:16.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:16.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:16.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:17.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:17.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:17.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:17.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:18.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:18.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:18.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:18.625+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:19.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:19.397+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:19.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:19.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:20.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:20.397+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:20.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:20.709+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:21.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:21.401+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:21.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:21.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:22.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:22.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:22.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:22.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:23.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:23.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:23.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:23.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:24.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:24.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:24.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:24.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:25.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:25.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:25.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:25.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:26.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:26.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:26.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:26.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:27.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:27.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:27.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:27.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:28.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:28.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:28.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:28.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:29.547 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:29.545+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:29.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:29.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:30.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:30.521+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:30.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:30.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:31.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:31.481+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:31.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:31.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:32.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:32.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:32.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:32.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:33.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:33.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:33.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:33.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:34.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:34.481+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:34.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:34.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:35.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:35.473+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:35.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:35.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:36.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:36.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:36.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:36.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:37.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:37.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:37.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:37.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:38.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:38.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:38.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:38.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:39.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:39.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:39.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:39.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:40.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:40.645+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:40.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:40.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:41.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:41.633+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:41.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:41.868+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:42.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:42.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:42.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:42.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:43.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:43.608+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:43.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:43.872+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:44.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:44.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:44.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:44.892+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:45.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:45.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:45.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:45.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:46.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:46.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:46.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:46.952+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:47.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:47.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:47.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:47.948+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:48.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:48.576+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:48.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:48.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:49.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:49.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:49.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:49.888+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:50.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:50.604+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:50.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:50.936+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:51.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:51.588+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:51.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:51.892+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:52.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:52.636+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:52.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:52.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:53.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:53.636+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:53.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:53.908+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:54.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:54.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:54.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:54.912+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:55.640 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:55.636+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:55.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:55.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:56.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:56.624+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:56.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:56.912+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:57.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:57.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:57.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:57.876+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:58.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:58.656+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:58.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:58.872+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:59.697 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:28:59.692+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:28:59.890 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:28:59.884+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:00.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:00.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:00.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:00.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:01.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:01.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:01.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:01.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:02.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:02.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:02.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:02.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:03.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:03.584+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:03.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:03.872+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:04.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:04.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:04.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:04.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:05.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:05.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:05.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:05.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:06.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:06.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:06.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:06.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:07.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:07.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:07.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:07.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:08.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:08.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:08.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:08.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:09.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:09.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:09.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:09.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:10.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:10.556+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:10.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:10.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:11.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:11.524+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:11.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:11.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:12.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:12.524+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:12.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:12.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:13.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:13.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:13.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:13.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:14.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:14.488+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:14.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:14.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:15.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:15.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:15.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:15.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:16.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:16.416+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:16.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:16.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:17.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:17.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:17.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:17.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:18.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:18.372+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:18.828 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:18.824+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:19.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:19.352+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:19.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:19.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:20.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:20.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:20.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:20.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:21.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:21.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:21.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:21.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:22.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:22.376+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:22.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:22.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:23.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:23.376+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:23.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:23.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:24.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:24.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:24.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:24.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:25.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:25.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:25.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:25.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:26.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:26.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:26.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:26.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:27.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:27.420+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:27.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:27.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:28.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:28.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:28.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:28.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:29.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:29.359+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:29.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:29.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:30.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:30.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:30.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:30.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:31.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:31.375+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:31.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:31.775+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:32.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:32.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:32.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:32.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:33.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:33.359+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:33.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:33.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:34.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:34.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:34.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:34.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:35.397 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:35.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:35.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:35.883+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:36.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:36.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:36.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:36.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:37.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:37.355+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:37.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:37.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:38.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:38.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:38.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:38.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:39.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:39.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:39.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:39.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:40.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:40.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:40.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:40.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:41.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:41.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:41.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:41.863+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:42.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:42.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:42.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:42.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:43.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:43.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:43.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:43.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:44.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:44.339+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:44.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:44.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:45.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:45.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:45.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:45.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:46.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:46.255+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:46.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:46.883+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:47.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:47.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:47.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:47.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:48.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:48.207+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:48.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:48.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:49.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:49.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:49.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:49.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:50.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:50.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:50.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:50.919+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:51.173 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:51.167+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:51.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:51.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:52.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:52.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:52.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:52.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:53.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:53.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:53.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:53.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:54.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:54.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:55.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:54.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:55.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:55.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:56.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:56.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:56.234 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:56.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:56.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:56.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:57.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:57.255+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:58.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:58.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:58.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:58.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:59.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:29:59.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:29:59.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:29:59.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:00.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:00.067+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:00.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:00.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:01.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:01.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:01.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:01.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:02.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:02.095+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:02.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:02.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:03.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:03.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:03.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:03.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:04.167 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:04.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:04.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:04.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:05.188 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:05.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:05.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:05.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:06.225 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:06.219+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:06.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:06.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:07.248 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:07.243+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:07.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:07.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:08.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:08.255+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:08.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:08.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:09.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:09.287+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:09.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:09.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:10.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:10.323+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:10.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:10.387+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:11.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:11.351+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:11.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:11.363+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:12.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:12.335+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:12.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:12.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:13.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:13.347+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:13.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:13.351+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:14.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:14.354+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:14.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:14.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:15.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:15.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:15.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:15.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:16.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:16.346+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:16.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:16.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:17.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:17.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:17.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:17.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:18.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:18.386+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:18.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:18.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:19.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:19.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:19.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:19.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:20.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:20.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:20.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:20.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:21.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:21.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:21.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:21.418+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:22.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:22.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:22.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:22.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:23.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:23.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:23.480 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:23.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:24.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:24.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:24.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:24.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:25.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:25.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:25.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:25.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:26.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:26.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:26.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:26.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:27.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:27.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:27.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:27.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:28.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:28.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:28.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:28.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:29.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:29.446+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:29.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:29.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:30.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:30.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:30.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:30.538+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:31.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:31.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:31.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:31.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:32.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:32.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:32.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:32.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:33.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:33.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:33.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:33.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:34.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:34.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:34.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:34.610+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:35.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:35.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:35.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:35.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:36.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:36.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:36.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:36.598+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:37.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:37.438+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:37.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:37.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:38.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:38.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:38.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:38.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:39.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:39.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:39.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:39.490+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:40.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:40.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:40.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:40.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:41.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:41.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:41.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:41.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:42.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:42.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:42.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:42.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:43.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:43.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:43.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:43.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:44.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:44.446+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:44.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:44.538+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:45.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:45.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:45.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:45.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:46.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:46.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:46.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:46.582+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:47.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:47.398+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:47.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:47.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:48.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:48.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:48.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:48.646+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:49.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:49.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:49.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:49.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:50.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:50.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:50.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:50.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:51.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:51.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:51.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:51.634+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:52.286 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:52.278+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:52.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:52.650+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:53.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:53.274+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:53.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:53.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:54.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:54.254+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:54.621 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:54.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:55.232 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:55.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:55.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:55.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:56.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:56.242+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:56.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:56.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:57.235 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:57.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:57.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:57.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:58.241 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:58.234+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:58.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:58.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:59.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:30:59.278+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:30:59.655 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:30:59.646+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:00.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:00.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:00.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:00.661+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:01.331 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:01.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:01.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:01.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:02.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:02.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:02.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:02.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:03.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:03.361+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:03.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:03.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:04.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:04.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:04.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:04.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:05.281 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:05.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:05.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:05.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:06.276 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:06.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:06.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:06.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:07.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:07.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:07.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:07.813+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:08.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:08.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:08.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:08.793+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:09.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:09.309+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:09.829 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:09.825+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:10.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:10.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:10.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:10.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:11.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:11.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:11.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:11.917+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:12.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:12.261+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:12.881 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:12.877+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:13.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:13.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:13.899 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:13.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:14.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:14.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:14.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:14.937+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:15.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:15.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:15.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:15.961+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:16.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:16.297+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:16.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:16.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:17.264 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:17.261+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:17.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:17.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:18.276 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:18.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:18.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:18.913+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:19.297 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:19.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:19.881 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:19.877+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:20.306 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:20.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:20.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:20.921+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:21.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:21.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:21.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:21.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:22.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:22.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:22.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:22.941+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:23.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:23.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:23.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:23.929+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:24.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:24.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:24.912 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:24.909+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:25.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:25.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:25.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:25.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:26.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:26.241+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:26.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:26.973+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:27.245 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:27.241+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:27.937 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:27.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:28.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:28.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:28.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:28.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:29.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:29.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:29.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:29.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:30.297 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:30.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:30.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:30.961+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:31.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:31.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:31.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:31.941+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:32.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:32.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:32.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:32.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:33.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:33.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:33.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:33.949+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:34.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:34.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:34.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:34.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:35.242 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:35.237+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:35.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:35.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:36.251 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:36.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:36.969 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:36.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:37.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:37.297+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:37.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:37.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:38.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:38.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:38.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:38.929+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:39.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:39.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:39.899 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:39.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:40.370 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:40.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:40.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:40.921+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:41.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:41.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:41.903 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:41.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:42.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:42.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:42.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:42.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:43.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:43.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:43.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:43.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:44.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:44.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:44.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:44.829+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:45.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:45.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:45.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:45.837+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:46.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:46.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:46.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:46.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:47.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:47.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:47.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:47.844+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:48.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:48.316+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:48.866 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:48.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:49.357 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:49.352+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:49.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:49.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:50.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:50.384+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:50.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:50.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:51.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:51.424+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:51.911 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:51.908+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:52.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:52.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:52.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:52.912+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:53.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:53.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:53.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:53.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:54.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:54.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:54.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:54.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:55.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:55.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:55.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:55.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:56.479 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:56.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:56.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:56.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:57.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:57.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:57.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:57.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:58.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:58.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:58.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:31:58.952+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:31:59.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:31:59.516+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:00.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:00.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:00.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:00.564+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:01.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:01.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:01.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:01.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:02.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:02.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:02.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:02.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:03.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:03.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:03.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:03.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:04.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:04.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:04.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:04.548+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:05.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:05.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:05.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:05.512+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:06.148 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:06.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:06.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:06.540+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:07.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:07.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:07.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:07.492+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:08.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:08.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:08.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:08.508+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:09.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:09.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:09.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:09.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:10.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:10.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:10.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:10.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:11.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:11.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:11.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:11.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:12.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:12.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:12.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:12.512+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:13.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:13.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:13.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:13.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:14.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:14.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:14.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:14.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:15.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:15.004+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:15.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:15.376+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:15.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:15.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:16.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:16.384+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:17.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:16.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:17.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:17.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:18.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:18.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:18.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:18.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:19.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:19.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:19.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:19.412+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:20.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:20.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:20.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:20.460+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:21.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:21.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:21.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:21.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:22.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:22.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:22.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:22.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:22.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:22.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:23.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:23.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:24.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:24.028+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:24.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:24.484+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:25.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:25.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:25.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:25.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:25.964 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:25.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:26.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:26.488+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:26.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:26.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:27.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:27.536+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:27.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:27.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:28.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:28.492+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:28.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:28.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:29.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:29.536+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:29.940 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:29.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:30.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:30.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:30.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:30.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:31.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:31.552+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:31.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:31.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:32.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:32.539+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:32.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:32.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:33.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:33.563+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:33.981 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:33.975+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:34.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:34.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:35.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:35.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:35.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:35.579+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:36.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:36.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:36.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:36.579+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:36.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:36.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:37.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:37.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:37.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:37.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:38.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:38.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:38.930 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:38.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:39.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:39.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:39.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:39.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:40.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:40.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:40.885 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:40.879+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:41.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:41.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:41.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:41.831+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:42.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:42.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:42.828 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:42.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:43.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:43.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:43.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:43.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:44.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:44.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:44.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:44.803+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:45.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:45.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:45.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:45.779+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:46.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:46.679+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:46.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:46.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:47.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:47.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:47.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:47.759+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:48.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:48.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:48.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:48.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:49.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:49.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:49.835 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:49.831+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:50.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:50.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:50.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:50.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:51.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:51.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:51.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:51.767+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:52.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:52.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:52.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:52.747+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:53.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:53.535+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:53.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:53.711+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:54.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:54.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:54.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:54.727+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:55.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:55.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:55.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:55.707+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:56.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:56.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:56.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:56.755+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:57.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:57.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:57.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:57.743+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:58.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:58.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:58.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:58.727+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:59.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:32:59.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:32:59.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:32:59.767+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:00.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:00.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:00.783 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:00.779+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:01.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:01.535+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:01.805 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:01.799+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:02.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:02.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:02.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:02.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:03.470 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:03.463+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:03.846 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:03.839+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:04.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:04.427+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:04.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:04.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:05.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:05.411+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:05.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:05.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:06.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:06.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:06.790 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:06.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:07.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:07.359+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:07.842 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:07.835+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:08.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:08.323+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:08.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:08.863+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:09.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:09.351+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:09.828 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:09.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:10.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:10.319+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:10.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:10.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:11.337 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:11.331+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:11.903 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:11.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:12.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:12.319+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:12.940 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:12.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:13.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:13.291+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:13.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:13.903+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:14.274 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:14.267+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:14.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:14.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:15.241 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:15.235+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:15.886 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:15.879+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:16.215 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:16.211+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:16.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:16.835+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:17.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:17.231+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:17.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:17.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:18.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:18.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:18.806 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:18.798+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:19.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:19.242+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:19.834 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:19.826+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:20.207 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:20.202+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:20.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:20.822+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:21.167 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:21.162+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:21.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:21.794+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:22.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:22.122+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:22.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:22.766+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:23.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:23.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:23.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:23.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:24.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:24.110+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:24.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:24.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:25.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:25.146+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:25.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:25.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:26.188 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:26.182+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:26.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:26.694+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:27.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:27.230+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:27.696 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:27.690+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:28.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:28.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:28.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:28.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:29.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:29.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:29.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:29.754+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:30.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:30.130+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:30.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:30.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:31.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:31.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:31.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:31.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:32.220 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:32.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:32.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:32.718+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:33.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:33.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:33.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:33.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:34.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:34.134+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:34.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:34.738+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:35.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:35.174+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:35.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:35.750+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:36.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:36.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:36.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:36.770+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:37.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:37.130+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:37.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:37.762+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:38.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:38.146+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:38.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:38.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:39.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:39.158+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:39.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:39.686+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:40.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:40.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:40.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:40.718+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:41.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:41.194+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:41.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:41.694+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:42.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:42.194+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:42.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:42.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:43.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:43.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:43.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:43.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:44.186 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:44.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:44.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:44.706+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:45.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:45.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:45.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:45.750+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:46.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:46.194+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:46.725 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:46.718+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:47.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:47.198+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:47.762 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:47.754+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:48.186 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:48.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:48.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:48.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:49.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:49.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:49.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:49.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:50.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:50.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:50.803 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:50.798+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:51.278 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:51.270+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:51.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:51.842+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:52.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:52.250+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:52.899 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:52.894+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:53.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:53.298+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:53.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:53.850+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:54.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:54.318+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:54.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:54.870+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:55.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:55.346+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:55.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:55.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:56.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:56.318+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:56.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:56.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:57.319 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:57.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:57.805 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:57.798+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:58.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:58.282+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:58.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:58.778+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:59.241 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:33:59.234+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:33:59.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:33:59.742+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:00.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:00.250+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:00.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:00.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:01.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:01.278+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:01.817 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:01.810+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:02.309 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:02.302+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:02.830 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:02.822+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:03.309 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:03.302+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:03.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:03.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:04.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:04.257+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:04.766 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:04.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:05.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:05.217+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:05.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:05.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:06.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:06.261+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:06.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:06.733+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:07.281 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:07.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:07.768 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:07.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:08.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:08.229+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:08.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:08.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:09.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:09.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:09.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:09.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:10.193 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:10.189+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:10.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:10.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:11.214 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:11.209+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:11.920 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:11.917+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:12.233 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:12.229+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:12.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:12.921+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:13.205 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:13.201+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:13.902 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:13.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:14.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:14.221+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:14.897 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:14.893+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:15.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:15.233+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:15.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:15.853+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:16.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:16.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:16.815 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:16.813+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:17.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:17.233+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:17.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:17.793+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:18.192 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:18.189+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:18.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:18.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:19.242 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:19.237+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:19.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:19.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:20.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:20.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:20.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:20.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:21.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:21.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:21.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:21.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:22.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:22.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:22.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:22.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:23.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:23.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:23.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:23.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:24.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:24.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:24.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:24.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:25.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:25.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:25.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:25.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:26.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:26.369+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:26.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:26.821+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:27.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:27.361+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:27.803 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:27.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:28.357 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:28.353+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:28.829 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:28.825+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:29.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:29.353+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:29.821 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:29.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:30.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:30.369+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:30.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:30.837+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:31.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:31.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:31.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:31.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:32.399 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:32.397+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:32.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:32.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:33.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:33.381+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:33.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:33.837+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:34.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:34.337+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:34.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:34.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:35.360 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:35.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:35.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:35.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:36.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:36.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:36.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:36.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:37.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:37.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:37.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:37.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:38.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:38.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:38.771 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:38.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:39.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:39.333+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:39.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:39.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:40.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:40.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:40.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:40.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:41.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:41.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:41.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:41.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:42.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:42.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:42.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:42.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:43.286 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:43.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:43.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:43.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:44.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:44.305+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:44.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:44.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:45.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:45.305+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:45.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:45.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:46.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:46.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:46.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:46.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:47.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:47.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:47.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:47.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:48.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:48.273+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:48.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:48.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:49.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:49.233+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:49.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:49.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:50.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:50.216+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:50.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:50.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:51.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:51.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:51.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:51.716+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:52.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:52.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:52.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:52.740+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:53.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:53.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:53.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:53.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:54.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:54.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:54.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:54.828+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:55.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:55.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:55.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:55.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:56.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:56.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:56.815 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:56.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:57.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:57.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:57.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:57.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:58.358 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:58.352+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:58.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:58.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:59.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:34:59.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:34:59.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:34:59.760+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:00.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:00.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:00.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:00.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:01.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:01.368+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:01.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:01.760+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:02.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:02.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:02.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:02.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:03.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:03.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:03.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:03.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:04.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:04.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:04.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:04.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:05.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:05.412+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:05.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:05.744+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:06.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:06.392+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:06.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:06.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:07.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:07.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:07.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:07.744+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:08.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:08.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:08.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:08.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:09.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:09.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:09.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:09.804+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:10.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:10.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:10.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:10.840+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:11.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:11.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:11.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:11.804+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:12.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:12.532+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:12.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:12.840+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:13.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:13.524+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:13.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:13.868+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:14.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:14.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:14.860 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:14.856+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:15.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:15.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:15.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:15.868+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:16.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:16.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:16.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:16.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:17.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:17.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:17.853 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:17.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:18.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:18.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:18.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:18.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:19.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:19.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:19.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:19.816+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:20.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:20.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:20.866 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:20.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:21.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:21.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:21.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:21.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:22.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:22.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:22.908 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:22.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:23.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:23.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:23.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:23.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:24.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:24.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:24.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:24.880+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:25.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:25.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:25.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:25.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:26.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:26.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:26.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:26.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:27.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:27.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:27.892 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:27.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:28.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:28.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:28.931 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:28.928+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:29.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:29.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:29.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:29.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:30.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:30.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:30.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:30.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:31.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:31.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:31.829 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:31.824+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:32.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:32.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:32.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:32.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:33.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:33.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:33.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:33.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:34.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:34.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:34.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:34.912+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:35.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:35.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:35.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:35.887+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:36.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:36.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:36.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:36.939+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:37.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:37.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:37.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:37.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:38.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:38.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:38.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:38.971+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:39.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:39.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:40.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:40.019+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:40.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:40.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:41.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:41.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:41.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:41.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:42.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:42.095+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:42.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:42.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:43.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:43.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:43.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:43.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:44.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:44.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:44.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:44.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:45.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:45.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:45.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:45.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:46.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:46.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:46.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:46.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:47.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:47.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:47.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:47.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:48.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:48.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:48.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:48.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:49.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:49.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:49.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:49.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:50.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:50.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:50.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:50.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:51.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:51.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:51.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:51.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:52.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:52.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:52.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:52.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:53.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:53.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:53.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:53.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:53.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:53.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:54.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:54.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:54.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:54.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:55.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:55.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:55.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:55.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:56.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:56.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:57.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:57.019+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:57.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:57.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:58.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:58.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:58.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:58.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:59.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:35:59.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:35:59.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:35:59.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:00.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:00.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:00.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:00.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:01.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:01.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:01.928 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:01.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:02.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:02.011+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:02.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:02.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:02.977 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:02.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:03.929 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:03.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:03.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:03.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:04.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:04.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:04.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:04.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:05.911 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:05.907+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:05.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:05.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:06.946 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:06.939+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:06.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:06.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:07.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:07.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:07.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:07.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:08.946 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:08.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:08.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:08.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:09.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:09.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:09.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:09.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:10.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:10.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:10.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:10.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:11.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:11.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:11.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:11.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:12.904 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:12.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:12.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:12.911+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:13.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:13.887+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:13.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:13.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:14.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:14.871+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:14.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:14.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:15.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:15.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:15.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:15.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:16.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:16.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:16.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:16.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:17.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:17.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:17.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:17.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:18.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:18.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:18.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:18.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:19.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:19.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:19.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:19.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:20.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:20.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:20.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:20.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:21.906 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:21.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:21.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:21.926+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:22.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:22.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:22.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:22.942+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:23.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:23.910+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:23.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:23.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:24.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:24.882+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:24.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:24.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:25.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:25.926+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:25.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:25.930+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:26.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:26.902+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:26.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:26.902+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:27.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:27.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:27.886 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:27.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:28.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:28.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:28.896 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:28.890+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:29.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:29.822+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:29.904 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:29.898+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:30.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:30.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:30.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:30.902+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:31.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:31.870+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:31.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:31.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:32.899 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:32.894+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:32.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:32.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:33.863 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:33.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:33.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:33.966+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:34.817 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:34.810+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:34.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:34.922+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:35.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:35.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:35.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:35.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:36.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:36.842+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:36.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:36.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:37.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:37.830+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:37.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:37.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:38.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:38.838+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:38.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:38.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:39.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:39.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:39.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:39.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:40.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:40.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:40.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:40.962+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:41.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:41.818+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:42.013 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:42.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:42.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:42.794+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:43.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:43.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:43.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:43.762+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:44.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:44.062+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:44.822 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:44.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:45.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:45.062+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:45.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:45.802+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:46.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:46.074+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:46.766 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:46.758+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:47.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:47.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:47.769 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:47.762+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:48.006 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:47.998+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:48.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:48.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:49.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:49.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:49.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:49.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:49.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:49.990+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:50.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:50.806+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:50.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:50.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:51.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:51.806+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:51.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:51.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:52.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:52.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:52.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:52.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:53.846 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:53.838+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:53.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:53.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:54.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:54.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:54.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:54.954+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:55.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:55.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:55.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:55.930+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:56.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:56.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:56.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:56.914+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:57.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:57.850+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:57.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:57.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:58.886 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:58.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:58.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:58.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:59.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:36:59.870+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:36:59.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:36:59.942+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:00.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:00.850+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:00.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:00.922+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:01.838 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:01.830+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:01.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:01.922+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:02.805 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:02.798+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:02.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:02.966+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:03.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:03.754+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:03.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:03.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:04.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:04.778+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:04.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:04.906+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:05.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:05.750+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:05.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:05.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:06.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:06.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:06.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:06.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:07.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:07.765+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:07.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:07.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:08.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:08.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:08.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:08.893+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:09.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:09.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:09.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:09.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:10.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:10.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:10.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:10.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:11.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:11.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:11.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:11.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:12.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:12.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:12.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:12.929+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:13.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:13.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:13.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:13.893+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:14.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:14.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:14.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:14.917+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:15.698 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:15.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:15.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:15.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:16.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:16.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:16.971 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:16.965+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:17.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:17.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:17.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:17.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:18.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:18.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:18.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:18.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:19.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:19.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:19.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:19.901+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:20.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:20.673+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:20.875 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:20.869+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:21.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:21.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:21.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:21.885+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:22.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:22.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:22.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:22.885+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:23.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:23.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:23.890 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:23.885+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:24.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:24.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:24.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:24.937+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:25.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:25.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:25.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:25.937+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:26.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:26.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:26.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:26.953+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:27.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:27.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:27.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:27.957+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:28.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:28.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:28.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:28.913+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:29.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:29.797+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:29.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:29.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:30.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:30.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:30.880 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:30.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:31.792 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:31.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:31.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:31.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:32.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:32.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:32.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:32.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:33.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:33.729+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:33.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:33.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:34.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:34.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:34.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:34.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:35.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:35.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:35.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:35.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:36.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:36.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:36.810 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:36.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:37.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:37.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:37.848 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:37.845+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:38.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:38.709+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:38.899 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:38.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:39.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:39.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:39.867 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:39.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:40.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:40.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:40.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:40.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:41.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:41.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:41.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:41.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:42.747 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:42.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:42.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:42.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:43.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:43.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:43.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:43.793+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:44.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:44.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:44.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:44.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:45.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:45.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:45.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:45.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:46.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:46.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:46.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:46.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:47.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:47.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:47.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:47.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:48.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:48.765+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:48.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:48.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:49.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:49.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:49.806 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:49.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:50.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:50.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:50.803 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:50.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:51.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:51.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:51.817 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:51.813+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:52.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:52.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:52.863 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:52.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:53.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:53.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:53.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:53.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:54.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:54.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:54.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:54.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:55.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:55.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:55.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:55.884+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:56.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:56.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:56.922 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:56.916+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:57.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:57.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:57.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:57.880+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:58.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:58.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:58.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:58.844+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:59.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:37:59.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:37:59.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:37:59.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:00.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:00.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:00.768 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:00.764+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:01.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:01.724+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:01.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:01.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:02.696 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:02.692+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:02.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:02.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:03.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:03.656+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:03.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:03.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:04.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:04.620+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:04.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:04.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:05.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:05.628+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:05.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:05.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:06.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:06.596+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:06.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:06.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:07.589 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:07.584+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:07.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:07.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:08.640 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:08.636+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:08.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:08.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:09.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:09.588+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:09.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:09.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:10.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:10.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:10.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:10.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:11.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:11.560+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:11.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:11.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:12.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:12.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:12.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:12.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:13.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:13.584+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:13.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:13.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:14.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:14.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:14.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:14.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:15.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:15.588+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:15.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:15.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:16.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:16.596+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:16.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:16.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:17.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:17.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:17.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:17.800+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:18.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:18.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:18.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:18.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:19.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:19.664+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:19.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:19.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:20.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:20.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:20.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:20.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:21.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:21.676+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:21.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:21.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:22.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:22.696+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:22.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:22.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:23.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:23.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:23.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:23.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:24.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:24.732+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:24.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:24.856+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:25.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:25.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:25.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:25.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:26.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:26.720+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:26.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:26.836+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:27.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:27.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:27.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:27.824+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:28.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:28.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:28.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:28.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:29.768 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:29.764+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:29.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:29.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:30.803 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:30.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:30.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:30.864+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:31.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:31.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:31.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:31.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:32.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:32.760+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:32.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:32.884+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:33.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:33.724+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:33.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:33.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:34.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:34.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:34.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:34.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:35.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:35.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:35.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:35.960+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:36.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:36.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:36.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:36.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:37.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:37.780+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:37.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:37.972+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:38.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:38.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:38.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:38.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:39.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:39.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:39.955 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:39.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:40.867 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:40.863+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:40.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:40.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:41.916 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:41.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:41.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:41.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:42.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:42.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:42.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:42.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:43.862 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:43.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:43.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:43.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:44.842 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:44.835+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:44.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:44.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:45.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:45.859+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:45.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:45.871+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:46.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:46.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:46.860 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:46.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:47.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:47.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:47.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:47.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:48.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:48.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:48.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:48.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:49.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:49.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:49.908 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:49.903+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:50.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:50.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:50.874 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:50.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:51.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:51.859+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:51.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:51.915+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:52.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:52.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:52.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:52.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:53.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:53.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:53.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:53.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:54.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:54.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:54.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:54.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:55.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:55.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:55.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:55.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:56.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:56.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:56.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:56.891+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:57.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:57.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:57.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:57.939+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:58.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:58.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:58.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:58.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:59.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:38:59.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:38:59.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:38:59.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:00.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:00.683+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:00.930 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:00.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:01.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:01.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:01.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:01.975+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:02.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:02.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:02.937 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:02.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:03.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:03.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:03.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:03.963+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:04.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:04.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:04.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:04.939+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:05.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:05.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:05.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:05.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:06.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:06.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:06.874 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:06.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:07.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:07.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:07.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:07.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:08.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:08.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:08.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:08.903+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:09.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:09.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:09.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:09.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:10.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:10.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:10.913 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:10.907+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:11.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:11.543+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:11.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:11.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:12.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:12.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:12.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:12.927+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:13.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:13.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:13.895 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:13.891+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:14.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:14.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:14.862 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:14.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:15.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:15.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:15.815 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:15.811+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:16.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:16.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:16.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:16.767+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:17.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:17.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:17.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:17.719+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:18.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:18.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:18.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:18.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:19.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:19.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:19.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:19.759+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:20.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:20.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:20.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:20.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:21.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:21.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:21.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:21.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:22.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:22.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:22.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:22.851+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:23.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:23.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:23.825 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:23.818+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:24.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:24.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:24.830 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:24.822+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:25.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:25.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:25.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:25.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:26.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:26.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:26.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:26.854+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:27.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:27.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:27.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:27.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:28.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:28.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:28.856 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:28.850+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:29.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:29.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:29.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:29.830+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:30.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:30.658+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:30.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:30.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:31.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:31.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:31.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:31.774+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:32.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:32.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:32.780 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:32.774+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:33.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:33.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:33.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:33.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:34.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:34.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:34.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:34.754+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:35.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:35.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:35.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:35.726+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:36.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:36.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:36.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:36.722+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:37.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:37.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:37.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:37.722+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:38.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:38.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:38.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:38.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:39.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:39.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:39.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:39.718+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:40.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:40.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:40.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:40.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:41.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:41.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:41.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:41.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:42.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:42.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:42.679 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:42.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:43.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:43.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:43.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:43.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:44.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:44.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:44.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:44.610+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:45.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:45.534+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:45.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:45.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:46.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:46.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:46.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:46.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:47.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:47.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:47.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:47.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:48.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:48.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:48.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:48.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:49.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:49.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:49.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:49.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:50.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:50.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:50.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:50.610+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:51.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:51.538+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:51.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:51.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:52.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:52.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:52.688 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:52.682+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:53.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:53.482+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:53.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:53.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:54.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:54.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:54.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:54.634+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:55.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:55.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:55.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:55.602+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:56.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:56.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:56.655 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:56.650+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:57.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:57.522+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:57.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:57.682+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:58.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:58.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:58.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:58.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:59.595 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:39:59.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:39:59.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:39:59.714+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:00.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:00.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:00.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:00.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:01.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:01.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:01.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:01.646+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:02.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:02.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:02.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:02.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:03.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:03.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:03.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:03.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:04.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:04.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:04.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:04.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:05.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:05.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:05.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:05.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:06.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:06.558+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:06.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:06.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:07.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:07.558+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:07.676 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:07.670+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:08.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:08.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:08.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:08.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:09.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:09.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:09.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:09.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:10.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:10.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:10.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:10.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:11.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:11.477+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:11.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:11.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:12.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:12.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:12.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:12.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:13.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:13.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:13.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:13.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:14.460 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:14.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:14.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:14.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:15.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:15.461+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:15.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:15.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:16.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:16.481+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:16.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:16.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:17.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:17.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:17.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:17.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:18.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:18.469+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:18.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:18.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:19.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:19.461+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:19.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:19.733+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:20.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:20.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:20.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:20.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:21.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:21.445+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:21.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:21.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:22.417 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:22.413+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:22.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:22.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:23.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:23.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:23.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:23.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:24.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:24.369+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:24.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:24.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:25.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:25.361+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:25.766 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:25.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:26.335 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:26.333+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:26.768 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:26.765+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:27.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:27.297+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:27.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:27.797+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:28.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:28.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:28.829 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:28.825+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:29.306 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:29.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:29.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:29.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:30.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:30.297+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:30.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:30.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:31.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:31.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:31.769 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:31.765+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:32.286 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:32.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:32.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:32.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:33.262 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:33.257+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:33.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:33.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:34.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:34.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:34.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:34.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:35.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:35.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:35.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:35.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:36.281 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:36.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:36.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:36.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:37.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:37.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:37.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:37.729+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:38.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:38.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:38.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:38.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:39.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:39.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:39.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:39.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:40.274 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:40.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:40.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:40.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:41.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:41.309+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:41.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:41.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:42.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:42.337+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:42.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:42.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:43.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:43.305+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:43.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:43.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:44.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:44.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:44.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:44.729+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:45.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:45.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:45.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:45.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:46.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:46.369+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:46.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:46.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:47.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:47.353+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:47.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:47.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:48.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:48.377+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:48.688 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:48.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:49.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:49.401+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:49.719 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:49.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:50.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:50.405+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:50.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:50.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:51.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:51.361+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:51.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:51.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:52.410 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:52.405+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:52.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:52.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:53.399 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:53.393+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:53.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:53.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:54.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:54.401+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:54.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:54.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:55.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:55.440+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:55.730 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:55.724+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:56.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:56.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:56.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:56.688+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:57.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:57.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:57.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:57.644+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:58.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:58.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:58.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:58.656+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:59.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:40:59.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:40:59.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:40:59.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:00.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:00.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:00.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:00.600+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:01.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:01.424+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:01.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:01.580+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:02.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:02.380+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:02.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:02.624+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:03.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:03.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:03.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:03.636+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:04.327 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:04.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:04.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:04.668+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:05.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:05.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:05.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:05.716+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:06.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:06.324+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:06.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:06.728+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:07.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:07.292+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:07.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:07.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:08.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:08.300+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:08.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:08.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:09.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:09.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:09.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:09.764+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:10.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:10.232+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:10.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:10.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:11.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:11.216+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:11.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:11.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:12.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:12.220+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:12.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:12.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:13.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:13.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:13.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:13.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:14.278 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:14.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:14.766 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:14.760+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:15.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:15.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:15.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:15.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:16.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:16.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:16.817 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:16.812+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:17.228 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:17.224+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:17.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:17.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:18.256 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:18.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:18.834 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:18.828+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:19.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:19.220+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:19.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:19.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:20.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:20.200+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:20.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:20.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:21.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:21.248+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:21.902 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:21.896+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:22.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:22.296+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:22.920 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:22.916+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:23.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:23.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:23.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:23.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:24.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:24.240+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:24.981 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:24.976+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:25.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:25.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:25.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:25.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:26.281 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:26.276+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:26.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:26.976+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:27.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:27.296+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:27.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:27.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:28.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:28.316+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:28.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:28.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:29.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:29.288+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:29.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:29.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:30.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:30.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:31.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:31.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:31.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:31.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:32.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:32.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:32.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:32.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:33.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:33.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:33.281 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:33.276+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:34.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:34.068+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:34.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:34.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:35.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:35.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:35.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:35.316+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:36.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:36.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:36.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:36.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:37.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:37.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:37.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:37.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:38.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:38.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:38.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:38.304+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:39.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:38.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:39.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:39.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:39.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:39.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:40.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:40.367+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:41.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:41.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:41.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:41.323+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:41.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:41.979+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:42.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:42.351+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:42.969 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:42.963+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:43.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:43.331+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:43.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:43.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:44.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:44.315+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:44.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:44.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:45.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:45.311+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:45.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:45.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:46.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:46.315+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:47.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:47.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:47.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:47.291+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:48.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:48.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:48.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:48.263+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:49.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:49.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:49.239 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:49.235+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:50.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:50.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:50.196 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:50.191+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:51.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:51.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:51.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:51.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:52.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:52.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:52.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:52.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:53.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:53.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:53.211 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:53.203+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:54.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:54.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:54.193 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:54.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:55.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:55.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:55.224 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:55.219+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:56.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:56.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:56.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:56.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:57.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:57.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:57.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:57.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:58.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:58.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:58.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:58.191+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:59.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:41:59.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:41:59.209 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:41:59.203+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:00.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:00.155+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:00.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:00.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:01.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:01.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:01.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:01.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:02.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:02.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:02.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:02.171+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:03.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:03.131+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:03.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:03.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:04.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:04.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:04.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:04.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:05.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:05.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:05.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:05.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:06.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:06.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:06.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:06.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:07.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:07.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:07.149 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:07.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:08.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:08.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:08.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:08.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:09.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:09.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:09.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:09.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:10.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:10.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:10.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:10.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:11.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:11.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:11.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:11.091+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:12.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:12.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:12.145 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:12.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:13.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:13.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:13.185 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:13.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:14.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:14.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:14.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:14.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:15.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:15.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:15.193 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:15.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:16.067 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:16.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:16.221 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:16.215+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:17.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:17.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:17.228 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:17.223+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:18.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:18.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:18.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:18.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:19.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:19.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:19.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:19.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:20.120 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:20.115+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:20.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:20.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:21.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:21.079+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:21.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:21.207+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:22.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:22.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:22.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:22.231+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:23.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:23.071+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:23.196 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:23.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:24.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:24.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:24.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:24.231+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:25.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:25.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:25.196 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:25.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:26.173 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:26.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:26.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:26.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:27.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:27.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:27.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:27.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:28.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:28.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:28.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:28.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:29.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:29.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:29.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:29.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:30.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:30.182+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:30.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:30.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:31.203 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:31.194+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:31.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:31.210+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:32.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:32.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:32.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:32.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:33.224 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:33.218+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:33.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:33.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:34.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:34.182+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:34.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:34.214+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:35.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:35.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:35.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:35.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:36.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:36.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:36.220 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:36.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:37.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:37.174+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:37.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:37.182+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:38.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:38.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:38.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:38.222+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:39.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:39.158+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:39.185 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:39.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:40.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:40.118+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:40.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:40.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:41.109 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:41.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:41.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:41.126+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:42.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:42.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:42.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:42.122+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:43.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:43.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:43.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:43.078+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:44.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:44.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:44.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:44.098+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:45.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:45.042+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:45.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:45.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:46.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:46.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:46.085 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:46.078+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:47.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:47.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:47.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:47.106+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:48.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:48.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:48.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:48.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:49.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:49.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:49.096 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:49.090+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:50.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:50.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:50.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:50.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:51.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:51.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:51.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:51.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:51.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:51.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:52.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:52.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:53.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:53.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:53.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:53.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:54.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:54.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:54.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:54.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:55.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:55.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:55.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:55.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:56.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:56.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:56.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:56.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:56.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:56.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:57.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:57.010+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:58.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:58.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:58.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:58.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:59.052 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:42:59.046+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:42:59.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:42:59.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:00.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:00.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:00.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:00.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:01.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:01.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:01.122 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:01.114+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:01.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:01.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:02.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:02.142+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:03.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:03.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:03.199 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:03.194+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:03.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:03.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:04.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:04.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:04.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:04.966+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:05.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:05.222+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:05.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:05.974+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:06.259 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:06.250+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:06.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:06.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:07.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:07.238+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:07.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:07.898+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:08.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:08.282+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:08.915 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:08.906+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:09.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:09.302+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:09.904 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:09.898+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:10.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:10.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:10.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:10.870+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:11.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:11.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:11.892 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:11.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:12.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:12.309+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:12.913 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:12.905+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:13.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:13.349+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:13.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:13.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:14.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:14.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:14.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:14.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:15.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:15.369+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:15.964 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:15.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:16.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:16.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:17.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:17.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:17.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:17.437+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:17.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:17.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:18.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:18.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:19.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:19.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:19.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:19.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:20.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:20.013+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:20.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:20.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:21.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:21.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:21.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:21.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:22.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:22.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:22.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:22.553+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:23.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:23.061+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:23.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:23.589+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:24.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:24.057+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:24.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:24.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:25.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:25.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:25.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:25.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:26.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:26.073+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:26.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:26.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:27.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:27.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:27.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:27.605+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:28.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:28.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:28.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:28.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:29.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:29.129+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:29.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:29.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:30.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:30.157+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:30.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:30.653+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:31.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:31.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:31.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:31.685+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:32.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:32.189+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:32.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:32.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:33.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:33.153+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:33.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:33.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:34.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:34.149+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:34.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:34.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:35.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:35.133+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:35.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:35.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:36.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:36.113+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:36.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:36.685+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:37.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:37.157+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:37.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:37.641+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:38.184 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:38.181+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:38.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:38.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:39.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:39.165+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:39.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:39.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:40.192 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:40.189+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:40.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:40.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:41.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:41.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:41.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:41.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:42.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:42.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:42.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:42.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:43.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:43.213+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:43.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:43.689+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:44.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:44.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:44.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:44.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:45.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:45.173+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:45.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:45.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:46.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:46.129+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:46.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:46.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:47.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:47.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:47.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:47.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:48.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:48.133+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:48.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:48.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:49.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:49.113+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:49.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:49.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:50.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:50.065+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:50.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:50.641+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:51.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:51.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:51.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:51.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:52.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:52.065+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:52.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:52.661+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:53.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:53.057+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:53.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:53.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:54.070 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:54.065+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:54.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:54.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:55.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:55.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:55.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:55.589+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:56.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:56.121+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:56.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:56.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:57.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:57.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:57.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:57.520+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:58.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:58.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:58.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:58.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:59.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:43:59.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:43:59.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:43:59.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:00.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:00.140+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:00.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:00.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:01.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:01.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:01.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:01.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:02.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:02.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:02.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:02.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:03.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:03.184+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:03.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:03.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:04.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:04.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:04.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:04.536+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:05.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:05.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:05.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:05.524+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:06.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:06.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:06.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:06.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:07.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:07.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:07.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:07.564+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:08.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:08.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:08.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:08.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:09.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:09.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:09.595 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:09.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:10.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:10.200+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:10.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:10.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:11.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:11.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:11.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:11.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:12.185 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:12.180+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:12.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:12.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:13.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:13.192+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:13.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:13.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:14.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:14.196+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:14.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:14.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:15.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:15.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:15.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:15.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:16.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:16.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:16.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:16.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:17.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:17.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:17.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:17.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:18.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:18.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:18.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:18.544+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:19.184 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:19.180+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:19.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:19.512+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:20.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:20.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:20.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:20.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:21.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:21.196+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:21.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:21.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:22.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:22.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:22.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:22.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:23.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:23.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:23.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:23.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:24.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:24.200+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:24.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:24.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:25.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:25.248+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:25.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:25.504+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:26.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:26.244+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:26.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:26.484+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:27.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:27.224+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:27.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:27.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:28.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:28.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:28.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:28.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:29.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:29.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:29.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:29.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:30.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:30.248+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:30.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:30.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:31.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:31.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:31.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:31.520+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:32.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:32.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:32.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:32.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:33.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:33.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:33.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:33.440+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:34.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:34.244+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:34.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:34.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:35.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:35.244+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:35.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:35.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:36.223 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:36.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:36.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:36.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:37.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:37.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:37.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:37.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:38.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:38.264+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:38.442 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:38.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:39.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:39.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:39.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:39.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:40.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:40.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:40.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:40.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:41.294 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:41.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:41.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:41.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:42.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:42.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:42.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:42.419+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:43.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:43.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:43.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:43.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:44.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:44.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:44.489 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:44.483+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:45.286 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:45.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:45.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:45.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:46.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:46.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:46.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:46.543+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:47.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:47.215+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:47.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:47.547+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:48.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:48.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:48.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:48.511+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:49.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:49.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:49.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:49.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:50.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:50.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:50.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:50.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:51.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:51.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:51.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:51.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:52.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:52.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:52.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:52.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:53.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:53.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:53.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:53.559+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:54.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:54.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:54.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:54.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:55.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:55.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:55.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:55.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:56.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:56.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:56.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:56.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:57.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:57.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:57.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:57.591+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:58.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:58.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:58.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:58.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:59.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:44:59.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:44:59.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:44:59.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:00.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:00.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:00.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:00.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:01.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:01.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:01.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:01.491+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:02.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:02.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:02.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:02.443+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:03.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:03.355+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:03.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:03.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:04.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:04.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:04.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:04.451+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:05.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:05.363+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:05.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:05.483+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:06.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:06.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:06.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:06.479+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:07.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:07.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:07.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:07.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:08.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:08.347+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:08.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:08.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:09.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:09.319+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:09.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:09.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:10.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:10.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:10.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:10.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:11.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:11.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:11.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:11.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:12.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:12.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:12.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:12.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:13.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:13.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:13.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:13.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:14.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:14.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:14.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:14.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:15.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:15.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:15.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:15.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:16.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:16.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:16.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:16.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:17.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:17.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:17.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:17.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:18.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:18.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:18.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:18.539+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:19.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:19.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:19.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:19.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:20.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:20.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:20.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:20.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:21.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:21.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:21.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:21.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:22.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:22.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:22.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:22.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:23.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:23.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:23.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:23.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:24.178 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:24.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:24.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:24.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:25.219 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:25.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:25.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:25.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:26.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:26.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:26.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:26.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:27.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:27.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:27.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:27.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:28.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:28.210+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:28.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:28.614+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:29.223 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:29.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:29.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:29.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:30.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:30.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:30.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:30.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:31.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:31.178+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:31.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:31.534+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:32.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:32.138+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:32.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:32.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:33.142 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:33.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:33.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:33.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:34.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:34.170+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:34.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:34.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:35.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:35.174+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:35.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:35.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:36.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:36.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:36.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:36.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:37.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:37.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:37.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:37.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:38.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:38.138+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:38.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:38.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:39.148 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:39.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:39.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:39.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:40.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:40.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:40.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:40.534+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:41.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:41.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:41.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:41.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:42.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:42.138+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:42.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:42.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:43.108 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:43.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:43.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:43.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:44.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:44.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:44.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:44.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:45.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:45.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:45.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:45.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:46.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:46.058+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:46.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:46.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:47.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:47.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:47.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:47.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:48.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:48.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:48.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:48.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:49.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:48.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:49.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:49.438+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:49.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:49.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:50.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:50.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:50.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:50.934+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:51.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:51.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:51.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:51.934+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:52.460 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:52.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:52.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:52.902+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:53.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:53.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:53.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:53.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:54.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:54.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:54.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:54.854+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:55.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:55.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:55.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:55.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:56.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:56.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:56.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:56.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:57.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:57.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:57.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:57.830+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:58.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:58.438+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:58.846 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:58.838+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:59.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:45:59.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:45:59.885 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:45:59.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:00.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:00.446+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:00.842 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:00.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:01.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:01.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:01.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:01.826+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:02.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:02.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:02.847 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:02.842+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:03.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:03.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:03.844 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:03.838+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:04.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:04.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:04.799 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:04.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:05.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:05.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:05.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:05.838+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:06.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:06.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:06.822 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:06.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:07.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:07.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:07.812 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:07.806+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:08.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:08.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:08.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:08.854+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:09.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:09.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:09.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:09.854+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:10.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:10.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:10.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:10.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:11.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:11.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:11.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:11.826+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:12.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:12.326+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:12.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:12.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:13.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:13.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:13.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:13.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:14.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:14.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:14.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:14.825+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:15.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:15.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:15.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:15.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:16.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:16.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:16.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:16.797+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:17.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:17.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:17.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:17.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:18.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:18.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:18.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:18.841+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:19.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:19.333+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:19.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:19.813+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:20.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:20.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:20.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:20.849+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:21.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:21.305+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:21.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:21.837+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:22.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:22.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:22.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:22.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:23.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:23.349+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:23.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:23.837+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:24.333 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:24.329+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:24.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:24.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:25.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:25.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:25.822 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:25.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:26.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:26.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:26.828 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:26.825+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:27.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:27.377+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:27.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:27.813+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:28.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:28.381+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:28.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:28.793+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:29.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:29.417+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:29.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:29.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:30.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:30.425+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:30.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:30.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:31.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:31.425+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:31.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:31.765+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:32.442 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:32.437+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:32.785 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:32.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:33.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:33.445+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:33.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:33.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:34.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:34.473+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:34.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:34.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:35.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:35.461+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:35.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:35.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:36.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:36.437+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:36.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:36.809+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:37.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:37.473+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:37.805 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:37.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:38.509 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:38.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:38.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:38.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:39.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:39.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:39.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:39.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:40.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:40.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:40.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:40.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:41.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:41.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:41.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:41.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:42.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:42.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:42.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:42.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:43.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:43.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:43.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:43.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:44.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:44.625+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:44.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:44.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:45.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:45.601+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:45.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:45.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:46.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:46.561+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:46.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:46.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:47.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:47.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:47.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:47.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:48.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:48.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:48.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:48.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:49.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:49.477+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:49.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:49.729+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:50.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:50.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:50.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:50.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:51.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:51.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:51.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:51.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:52.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:52.497+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:52.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:52.661+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:53.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:53.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:53.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:53.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:54.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:54.501+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:54.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:54.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:55.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:55.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:55.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:55.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:56.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:56.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:56.679 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:56.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:57.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:57.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:57.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:57.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:58.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:58.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:58.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:58.688+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:59.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:46:59.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:46:59.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:46:59.696+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:00.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:00.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:00.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:00.696+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:01.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:01.552+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:01.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:01.720+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:02.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:02.504+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:02.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:02.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:03.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:03.508+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:03.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:03.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:04.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:04.552+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:04.780 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:04.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:05.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:05.520+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:05.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:05.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:06.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:06.568+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:06.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:06.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:07.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:07.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:07.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:07.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:08.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:08.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:08.771 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:08.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:09.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:09.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:09.799 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:09.796+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:10.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:10.568+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:10.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:10.844+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:11.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:11.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:11.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:11.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:12.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:12.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:12.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:12.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:13.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:13.544+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:13.847 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:13.844+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:14.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:14.504+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:14.860 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:14.856+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:15.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:15.524+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:15.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:15.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:16.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:16.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:16.891 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:16.884+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:17.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:17.512+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:17.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:17.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:18.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:18.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:18.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:18.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:19.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:19.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:19.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:19.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:20.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:20.508+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:20.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:20.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:21.479 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:21.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:21.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:21.856+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:22.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:22.464+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:22.902 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:22.896+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:23.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:23.500+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:23.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:23.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:24.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:24.508+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:24.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:24.884+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:25.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:25.460+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:25.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:25.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:26.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:26.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:26.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:26.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:27.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:27.424+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:27.895 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:27.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:28.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:28.464+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:28.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:28.884+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:29.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:29.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:29.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:29.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:30.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:30.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:30.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:30.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:31.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:31.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:31.880 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:31.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:32.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:32.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:32.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:32.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:33.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:33.380+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:33.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:33.868+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:34.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:34.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:34.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:34.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:35.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:35.424+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:35.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:35.844+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:36.392 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:36.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:36.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:36.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:37.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:37.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:37.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:37.804+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:38.442 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:38.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:38.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:38.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:39.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:39.404+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:39.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:39.812+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:40.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:40.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:40.838 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:40.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:41.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:41.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:41.830 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:41.824+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:42.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:42.464+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:42.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:42.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:43.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:43.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:43.822 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:43.815+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:44.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:44.463+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:44.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:44.831+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:45.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:45.427+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:45.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:45.819+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:46.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:46.403+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:46.863 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:46.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:47.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:47.439+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:47.834 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:47.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:48.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:48.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:48.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:48.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:49.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:49.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:49.785 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:49.779+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:50.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:50.423+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:50.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:50.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:51.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:51.447+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:51.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:51.767+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:52.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:52.495+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:52.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:52.727+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:53.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:53.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:53.715 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:53.707+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:54.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:54.475+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:54.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:54.707+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:55.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:55.519+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:55.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:55.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:56.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:56.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:56.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:56.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:57.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:57.559+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:57.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:57.751+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:58.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:58.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:58.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:58.731+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:59.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:47:59.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:47:59.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:47:59.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:00.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:00.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:00.792 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:00.787+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:01.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:01.543+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:01.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:01.795+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:02.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:02.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:02.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:02.787+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:03.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:03.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:03.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:03.831+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:04.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:04.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:04.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:04.803+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:05.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:05.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:05.828 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:05.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:06.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:06.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:06.850 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:06.843+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:07.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:07.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:07.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:07.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:08.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:08.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:08.870 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:08.863+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:09.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:09.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:09.912 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:09.907+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:10.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:10.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:10.929 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:10.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:11.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:11.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:11.913 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:11.907+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:12.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:12.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:12.879 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:12.875+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:13.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:13.839+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:13.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:13.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:14.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:14.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:14.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:14.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:15.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:15.815+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:15.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:15.871+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:16.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:16.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:16.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:16.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:17.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:17.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:17.900 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:17.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:18.868 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:18.863+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:18.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:18.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:19.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:19.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:19.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:19.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:20.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:20.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:20.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:20.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:21.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:21.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:21.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:21.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:22.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:22.887+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:22.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:22.911+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:23.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:23.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:23.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:23.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:24.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:24.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:24.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:24.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:25.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:25.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:25.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:25.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:26.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:26.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:26.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:26.915+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:27.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:27.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:27.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:27.959+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:28.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:28.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:28.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:28.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:29.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:29.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:29.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:29.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:30.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:30.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:30.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:30.974+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:31.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:31.902+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:31.955 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:31.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:32.915 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:32.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:32.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:32.926+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:33.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:33.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:33.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:33.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:34.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:34.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:35.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:34.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:35.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:35.834+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:36.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:36.014+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:36.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:36.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:37.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:37.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:37.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:37.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:38.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:38.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:38.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:38.810+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:39.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:39.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:39.852 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:39.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:40.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:40.086+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:40.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:40.854+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:41.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:41.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:41.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:41.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:42.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:41.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:42.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:42.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:43.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:42.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:43.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:43.814+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:43.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:43.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:44.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:44.798+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:45.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:45.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:45.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:45.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:45.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:45.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:46.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:46.854+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:46.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:46.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:47.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:47.886+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:47.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:47.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:48.883 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:48.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:48.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:48.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:49.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:49.862+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:49.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:49.966+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:50.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:50.886+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:50.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:50.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:51.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:51.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:51.944 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:51.938+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:52.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:52.914+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:52.964 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:52.958+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:53.946 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:53.938+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:53.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:53.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:54.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:54.906+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:54.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:54.938+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:55.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:55.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:55.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:55.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:56.924 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:56.918+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:56.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:56.930+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:57.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:57.874+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:57.915 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:57.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:58.846 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:58.838+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:58.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:58.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:59.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:48:59.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:48:59.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:48:59.922+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:00.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:00.854+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:00.977 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:00.970+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:01.816 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:01.810+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:01.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:01.934+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:02.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:02.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:02.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:02.954+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:03.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:03.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:03.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:03.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:04.829 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:04.822+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:04.919 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:04.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:05.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:05.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:05.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:05.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:06.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:06.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:06.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:06.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:07.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:07.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:07.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:07.938+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:08.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:08.850+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:08.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:08.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:09.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:09.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:09.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:09.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:10.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:10.854+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:10.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:10.978+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:11.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:11.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:12.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:12.002+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:12.848 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:12.842+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:13.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:13.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:13.896 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:13.890+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:14.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:14.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:14.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:14.909+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:15.026 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:15.017+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:15.897 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:15.889+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:16.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:16.049+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:16.880 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:16.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:17.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:17.069+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:17.891 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:17.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:18.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:18.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:18.874 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:18.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:19.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:19.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:19.889 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:19.881+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:20.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:20.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:20.914 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:20.909+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:21.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:21.061+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:21.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:21.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:22.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:22.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:22.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:22.973+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:23.026 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:23.021+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:23.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:23.973+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:24.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:24.017+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:25.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:25.013+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:25.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:25.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:25.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:25.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:26.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:26.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:26.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:26.989+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:27.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:27.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:28.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:28.017+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:28.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:28.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:28.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:28.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:29.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:29.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:29.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:29.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:30.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:30.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:31.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:31.013+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:31.086 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:31.081+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:31.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:31.981+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:32.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:32.069+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:32.969 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:32.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:33.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:33.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:34.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:34.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:34.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:34.049+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:35.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:35.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:35.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:35.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:36.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:36.013+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:36.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:36.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:36.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:36.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:37.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:37.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:37.964 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:37.961+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:38.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:38.017+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:39.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:38.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:39.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:39.037+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:40.016 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:40.009+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:40.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:40.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:41.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:41.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:41.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:41.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:42.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:42.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:42.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:42.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:43.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:43.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:43.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:43.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:44.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:44.013+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:44.043 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:44.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:45.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:45.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:45.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:45.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:46.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:46.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:46.091 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:46.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:47.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:47.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:47.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:47.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:48.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:47.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:48.047 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:48.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:49.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:49.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:49.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:49.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:50.023 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:50.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:50.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:50.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:51.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:51.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:51.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:51.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:52.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:52.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:52.115 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:52.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:53.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:53.017+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:53.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:53.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:54.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:54.069+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:54.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:54.097+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:55.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:55.037+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:55.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:55.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:56.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:56.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:56.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:56.125+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:57.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:57.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:57.177 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:57.173+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:58.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:58.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:58.215 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:58.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:59.132 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:49:59.129+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:49:59.232 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:49:59.229+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:00.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:00.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:00.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:00.192+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:01.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:01.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:01.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:01.192+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:02.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:02.160+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:02.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:02.192+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:03.178 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:03.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:03.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:03.192+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:04.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:04.164+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:04.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:04.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:05.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:05.168+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:05.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:05.224+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:06.221 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:06.216+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:06.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:06.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:07.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:07.228+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:07.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:07.232+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:08.192 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:08.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:08.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:08.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:09.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:09.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:09.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:09.300+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:10.212 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:10.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:10.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:10.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:11.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:11.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:11.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:11.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:12.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:12.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:12.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:12.372+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:13.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:13.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:13.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:13.360+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:14.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:14.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:14.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:14.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:15.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:15.228+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:15.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:15.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:16.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:16.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:16.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:16.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:17.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:17.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:17.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:17.360+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:18.234 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:18.228+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:18.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:18.380+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:19.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:19.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:19.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:19.380+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:20.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:20.228+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:20.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:20.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:21.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:21.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:21.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:21.376+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:22.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:22.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:22.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:22.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:23.187 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:23.180+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:23.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:23.368+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:24.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:24.192+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:24.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:24.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:25.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:25.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:25.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:25.300+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:26.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:26.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:26.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:26.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:27.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:27.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:27.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:27.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:28.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:28.180+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:28.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:28.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:29.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:29.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:29.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:29.296+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:30.178 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:30.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:30.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:30.332+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:31.138 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:31.132+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:31.360 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:31.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:32.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:32.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:32.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:32.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:33.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:33.116+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:33.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:33.384+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:34.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:34.160+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:34.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:34.372+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:35.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:35.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:35.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:35.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:36.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:36.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:36.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:36.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:37.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:37.164+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:37.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:37.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:38.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:38.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:38.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:38.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:39.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:39.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:39.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:39.360+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:40.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:40.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:40.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:40.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:41.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:41.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:41.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:41.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:42.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:42.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:42.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:42.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:43.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:43.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:43.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:43.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:44.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:44.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:44.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:44.364+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:45.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:45.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:45.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:45.391+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:46.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:46.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:46.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:46.411+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:47.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:47.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:47.442 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:47.435+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:48.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:48.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:48.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:48.415+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:49.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:49.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:49.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:49.395+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:50.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:50.347+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:50.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:50.423+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:51.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:51.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:51.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:51.431+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:52.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:52.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:52.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:52.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:53.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:53.383+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:53.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:53.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:54.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:54.371+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:54.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:54.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:55.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:55.411+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:55.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:55.419+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:56.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:56.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:56.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:56.439+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:57.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:57.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:57.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:57.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:58.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:58.475+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:58.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:58.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:59.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:50:59.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:50:59.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:50:59.531+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:00.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:00.475+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:00.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:00.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:01.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:01.447+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:01.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:01.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:02.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:02.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:02.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:02.495+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:03.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:03.467+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:03.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:03.511+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:04.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:04.463+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:04.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:04.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:05.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:05.479+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:05.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:05.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:06.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:06.463+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:06.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:06.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:07.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:07.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:07.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:07.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:08.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:08.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:08.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:08.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:09.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:09.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:09.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:09.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:10.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:10.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:10.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:10.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:11.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:11.467+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:11.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:11.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:12.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:12.431+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:12.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:12.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:13.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:13.439+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:13.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:13.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:14.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:14.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:14.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:14.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:15.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:15.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:15.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:15.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:16.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:16.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:16.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:16.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:17.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:17.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:17.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:17.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:18.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:18.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:18.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:18.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:19.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:19.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:19.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:19.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:20.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:20.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:20.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:20.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:21.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:21.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:21.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:21.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:22.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:22.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:22.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:22.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:23.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:23.419+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:23.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:23.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:24.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:24.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:24.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:24.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:25.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:25.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:25.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:25.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:26.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:26.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:26.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:26.655+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:27.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:27.435+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:27.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:27.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:28.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:28.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:28.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:28.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:29.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:29.471+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:29.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:29.591+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:30.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:30.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:30.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:30.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:31.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:31.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:31.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:31.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:32.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:32.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:32.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:32.666+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:33.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:33.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:33.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:33.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:34.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:34.582+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:34.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:34.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:35.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:35.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:35.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:35.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:36.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:36.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:36.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:36.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:37.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:37.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:37.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:37.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:38.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:38.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:38.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:38.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:39.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:39.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:39.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:39.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:40.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:40.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:40.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:40.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:41.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:41.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:41.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:41.618+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:42.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:42.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:42.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:42.670+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:43.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:43.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:43.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:43.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:44.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:44.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:44.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:44.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:45.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:45.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:45.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:45.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:46.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:46.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:46.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:46.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:47.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:47.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:47.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:47.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:48.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:48.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:48.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:48.666+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:49.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:49.662+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:49.673 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:49.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:50.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:50.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:50.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:50.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:51.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:51.666+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:51.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:51.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:52.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:52.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:52.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:52.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:53.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:53.694+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:53.716 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:53.710+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:54.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:54.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:54.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:54.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:55.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:55.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:55.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:55.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:56.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:56.662+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:56.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:56.662+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:57.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:57.658+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:57.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:57.694+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:58.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:58.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:58.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:58.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:59.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:51:59.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:51:59.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:51:59.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:00.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:00.646+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:00.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:00.658+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:01.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:01.662+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:01.670 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:01.662+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:02.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:02.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:02.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:02.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:03.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:03.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:03.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:03.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:04.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:04.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:04.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:04.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:05.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:05.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:05.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:05.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:06.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:06.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:06.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:06.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:07.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:07.578+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:07.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:07.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:08.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:08.578+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:08.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:08.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:09.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:09.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:09.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:09.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:10.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:10.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:10.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:10.694+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:11.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:11.582+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:11.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:11.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:12.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:12.578+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:12.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:12.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:13.636 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:13.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:13.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:13.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:14.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:14.670+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:14.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:14.694+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:15.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:15.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:15.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:15.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:16.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:16.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:16.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:16.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:17.636 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:17.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:17.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:17.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:18.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:18.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:18.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:18.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:19.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:19.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:19.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:19.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:20.651 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:20.645+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:20.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:20.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:21.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:21.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:21.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:21.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:22.697 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:22.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:22.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:22.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:23.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:23.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:23.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:23.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:24.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:24.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:24.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:24.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:25.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:25.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:25.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:25.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:26.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:26.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:26.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:26.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:27.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:27.661+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:27.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:27.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:28.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:28.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:28.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:28.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:29.722 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:29.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:29.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:29.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:30.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:30.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:30.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:30.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:31.670 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:31.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:31.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:31.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:32.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:32.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:32.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:32.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:33.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:33.733+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:33.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:33.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:34.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:34.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:34.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:34.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:35.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:35.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:35.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:35.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:36.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:36.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:36.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:36.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:37.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:37.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:37.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:37.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:38.744 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:38.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:38.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:38.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:39.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:39.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:39.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:39.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:40.769 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:40.765+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:40.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:40.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:41.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:41.809+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:41.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:41.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:42.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:42.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:42.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:42.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:43.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:43.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:43.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:43.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:44.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:44.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:44.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:44.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:45.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:45.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:45.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:45.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:46.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:46.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:46.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:46.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:47.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:47.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:47.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:47.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:48.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:48.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:48.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:48.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:49.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:49.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:49.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:49.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:50.697 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:50.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:50.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:50.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:51.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:51.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:51.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:51.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:52.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:52.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:52.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:52.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:53.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:53.653+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:53.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:53.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:54.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:54.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:54.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:54.773+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:55.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:55.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:55.825 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:55.821+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:56.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:56.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:56.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:56.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:57.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:57.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:57.822 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:57.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:58.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:58.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:58.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:58.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:59.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:52:59.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:52:59.879 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:52:59.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:00.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:00.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:00.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:00.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:01.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:01.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:01.838 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:01.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:02.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:02.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:02.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:02.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:03.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:03.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:03.816 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:03.812+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:04.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:04.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:04.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:04.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:05.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:05.732+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:05.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:05.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:06.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:06.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:06.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:06.740+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:07.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:07.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:07.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:07.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:08.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:08.648+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:08.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:08.764+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:09.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:09.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:09.727 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:09.724+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:10.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:10.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:10.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:10.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:11.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:11.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:11.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:11.728+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:12.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:12.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:12.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:12.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:13.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:13.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:13.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:13.760+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:14.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:14.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:14.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:14.764+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:15.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:15.704+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:15.810 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:15.804+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:16.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:16.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:16.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:16.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:17.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:17.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:17.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:17.780+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:18.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:18.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:18.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:18.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:19.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:19.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:19.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:19.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:20.785 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:20.780+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:20.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:20.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:21.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:21.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:21.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:21.784+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:22.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:22.796+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:22.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:22.800+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:23.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:23.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:23.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:23.836+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:24.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:24.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:24.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:24.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:25.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:25.764+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:25.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:25.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:26.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:26.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:26.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:26.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:27.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:27.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:27.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:27.824+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:28.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:28.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:28.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:28.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:29.791 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:29.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:29.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:29.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:30.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:30.784+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:30.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:30.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:31.771 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:31.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:31.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:31.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:32.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:32.732+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:32.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:32.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:33.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:33.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:33.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:33.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:34.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:34.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:34.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:34.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:35.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:35.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:35.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:35.884+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:36.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:36.732+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:36.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:36.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:37.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:37.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:37.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:37.892+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:38.805 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:38.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:38.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:38.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:39.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:39.848+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:39.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:39.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:40.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:40.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:40.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:40.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:41.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:41.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:41.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:41.896+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:42.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:42.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:42.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:42.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:43.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:43.876+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:43.910 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:43.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:44.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:44.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:44.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:44.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:45.883 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:45.875+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:45.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:45.879+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:46.856 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:46.851+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:46.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:46.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:47.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:47.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:47.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:47.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:48.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:48.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:48.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:48.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:49.812 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:49.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:49.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:49.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:50.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:50.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:50.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:50.859+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:51.777 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:51.771+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:51.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:51.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:52.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:52.787+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:52.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:52.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:53.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:53.755+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:53.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:53.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:54.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:54.787+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:54.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:54.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:55.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:55.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:55.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:55.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:56.769 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:56.763+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:56.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:56.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:57.815 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:57.811+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:57.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:57.875+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:58.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:58.843+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:58.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:58.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:59.821 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:53:59.815+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:53:59.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:53:59.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:00.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:00.823+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:00.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:00.859+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:01.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:01.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:01.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:01.871+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:02.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:02.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:02.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:02.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:03.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:03.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:03.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:03.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:04.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:04.691+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:04.956 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:04.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:05.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:05.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:05.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:05.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:06.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:06.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:07.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:07.019+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:07.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:07.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:08.056 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:08.051+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:08.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:08.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:09.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:09.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:09.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:09.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:10.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:10.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:10.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:10.559+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:10.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:10.979+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:11.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:11.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:12.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:12.019+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:12.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:12.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:13.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:13.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:13.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:13.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:14.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:14.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:14.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:14.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:15.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:15.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:15.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:15.655+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:16.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:16.095+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:16.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:16.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:17.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:17.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:17.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:17.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:18.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:18.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:18.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:18.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:19.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:19.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:19.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:19.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:20.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:20.095+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:20.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:20.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:21.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:21.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:21.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:21.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:22.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:22.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:22.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:22.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:22.997 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:22.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:23.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:23.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:24.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:24.015+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:24.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:24.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:25.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:25.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:25.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:25.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:26.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:26.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:26.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:26.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:27.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:27.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:27.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:27.679+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:28.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:28.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:28.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:28.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:29.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:29.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:29.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:29.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:30.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:30.051+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:30.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:30.655+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:31.044 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:31.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:31.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:31.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:32.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:32.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:32.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:32.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:33.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:33.122+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:33.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:33.614+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:34.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:34.118+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:34.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:34.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:35.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:35.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:35.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:35.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:36.166 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:36.158+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:36.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:36.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:37.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:37.114+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:37.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:37.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:38.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:38.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:38.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:38.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:39.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:39.086+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:39.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:39.726+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:40.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:40.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:40.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:40.762+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:41.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:41.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:41.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:41.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:42.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:42.062+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:42.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:42.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:43.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:43.098+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:43.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:43.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:44.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:44.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:44.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:44.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:45.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:45.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:45.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:45.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:46.109 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:46.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:46.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:46.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:47.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:47.110+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:47.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:47.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:48.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:48.122+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:48.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:48.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:49.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:49.122+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:49.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:49.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:50.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:50.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:50.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:50.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:51.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:51.154+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:51.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:51.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:52.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:52.170+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:52.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:52.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:53.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:53.154+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:53.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:53.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:54.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:54.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:54.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:54.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:55.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:55.194+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:55.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:55.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:56.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:56.238+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:56.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:56.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:57.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:57.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:57.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:57.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:58.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:58.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:58.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:58.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:59.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:54:59.334+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:54:59.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:54:59.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:00.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:00.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:00.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:00.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:01.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:01.290+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:01.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:01.318+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:02.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:02.274+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:02.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:02.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:03.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:03.238+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:03.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:03.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:04.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:04.262+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:04.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:04.278+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:05.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:05.254+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:05.294 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:05.286+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:06.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:06.222+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:06.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:06.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:07.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:07.246+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:07.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:07.366+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:08.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:08.282+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:08.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:08.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:09.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:09.322+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:09.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:09.342+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:10.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:10.346+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:10.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:10.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:11.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:11.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:11.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:11.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:12.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:12.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:12.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:12.394+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:13.333 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:13.326+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:13.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:13.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:14.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:14.346+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:14.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:14.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:15.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:15.330+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:15.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:15.422+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:16.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:16.349+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:16.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:16.437+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:17.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:17.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:17.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:17.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:18.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:18.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:18.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:18.421+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:19.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:19.309+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:19.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:19.441+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:20.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:20.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:20.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:20.421+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:21.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:21.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:21.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:21.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:22.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:22.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:22.394 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:22.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:23.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:23.217+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:23.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:23.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:24.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:24.185+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:24.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:24.317+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:25.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:25.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:25.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:25.273+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:26.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:26.133+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:26.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:26.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:27.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:27.129+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:27.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:27.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:28.091 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:28.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:28.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:28.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:29.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:29.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:29.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:29.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:30.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:30.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:30.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:30.401+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:31.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:31.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:31.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:31.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:32.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:32.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:32.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:32.393+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:33.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:33.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:33.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:33.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:34.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:34.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:34.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:34.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:35.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:35.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:35.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:35.429+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:36.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:36.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:36.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:36.437+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:37.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:37.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:37.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:37.437+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:38.111 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:38.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:38.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:38.413+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:39.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:39.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:39.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:39.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:40.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:40.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:40.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:40.393+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:41.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:41.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:41.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:41.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:42.036 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:42.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:42.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:42.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:43.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:43.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:43.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:43.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:44.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:44.069+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:44.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:44.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:45.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:45.029+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:45.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:45.413+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:46.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:46.029+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:46.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:46.421+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:46.997 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:46.993+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:47.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:47.441+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:48.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:48.009+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:48.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:48.405+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:49.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:49.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:49.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:49.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:50.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:50.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:50.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:50.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:51.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:51.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:51.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:51.317+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:52.054 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:52.049+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:52.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:52.365+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:53.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:53.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:53.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:53.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:54.054 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:54.049+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:54.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:54.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:55.062 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:55.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:55.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:55.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:56.110 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:56.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:56.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:56.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:57.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:57.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:57.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:57.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:58.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:58.165+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:58.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:58.313+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:59.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:55:59.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:55:59.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:55:59.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:00.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:00.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:00.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:00.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:01.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:01.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:01.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:01.209+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:02.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:02.128+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:02.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:02.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:03.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:03.108+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:03.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:03.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:04.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:04.060+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:04.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:04.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:05.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:05.016+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:05.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:05.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:06.022 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:06.016+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:06.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:06.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:06.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:06.976+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:07.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:07.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:08.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:08.000+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:08.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:08.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:08.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:08.956+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:09.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:09.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:09.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:09.936+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:10.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:10.244+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:10.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:10.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:11.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:11.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:11.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:11.936+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:12.280 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:12.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:12.928 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:12.924+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:13.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:13.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:13.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:13.888+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:14.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:14.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:14.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:14.912+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:15.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:15.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:15.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:15.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:16.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:16.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:16.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:16.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:17.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:17.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:17.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:17.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:18.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:18.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:18.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:18.928+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:19.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:19.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:19.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:19.912+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:20.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:20.328+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:20.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:20.864+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:21.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:21.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:21.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:21.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:22.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:22.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:22.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:22.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:23.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:23.320+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:23.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:23.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:24.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:24.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:24.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:24.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:25.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:25.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:25.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:25.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:26.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:26.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:26.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:26.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:27.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:27.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:27.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:27.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:28.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:28.408+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:28.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:28.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:29.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:29.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:29.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:29.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:30.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:30.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:30.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:30.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:31.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:31.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:31.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:31.716+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:32.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:32.360+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:32.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:32.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:33.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:33.372+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:33.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:33.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:34.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:34.372+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:34.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:34.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:35.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:35.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:35.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:35.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:36.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:36.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:36.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:36.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:37.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:37.372+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:37.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:37.824+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:38.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:38.380+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:38.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:38.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:39.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:39.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:39.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:39.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:40.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:40.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:40.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:40.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:41.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:41.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:41.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:41.872+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:42.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:42.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:42.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:42.900+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:43.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:43.360+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:43.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:43.904+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:44.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:44.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:44.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:44.856+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:45.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:45.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:45.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:45.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:46.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:46.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:46.928 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:46.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:47.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:47.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:47.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:47.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:48.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:48.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:48.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:48.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:49.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:49.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:49.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:49.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:50.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:50.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:50.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:50.823+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:51.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:51.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:51.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:51.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:52.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:52.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:52.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:52.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:53.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:53.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:53.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:53.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:54.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:54.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:54.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:54.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:55.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:55.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:55.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:55.907+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:56.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:56.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:56.940 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:56.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:57.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:57.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:57.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:57.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:58.294 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:58.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:58.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:58.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:59.300 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:56:59.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:56:59.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:56:59.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:00.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:00.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:00.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:00.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:01.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:01.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:01.999 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:01.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:02.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:02.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:02.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:02.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:03.349 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:03.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:03.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:03.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:04.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:04.339+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:04.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:04.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:05.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:05.387+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:05.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:05.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:06.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:06.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:06.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:06.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:07.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:07.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:07.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:07.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:08.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:08.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:09.014 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:09.007+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:09.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:09.423+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:10.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:09.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:10.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:10.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:10.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:10.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:11.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:11.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:11.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:11.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:12.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:12.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:13.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:12.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:13.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:13.375+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:13.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:13.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:14.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:14.367+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:14.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:14.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:15.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:15.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:15.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:15.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:16.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:16.367+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:16.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:16.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:17.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:17.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:18.026 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:18.019+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:18.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:18.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:19.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:19.051+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:19.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:19.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:20.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:20.019+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:20.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:20.455+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:21.022 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:21.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:21.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:21.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:22.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:22.055+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:22.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:22.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:23.017 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:23.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:23.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:23.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:24.055 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:24.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:24.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:24.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:25.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:25.095+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:25.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:25.567+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:26.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:26.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:26.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:26.603+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:27.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:27.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:27.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:27.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:28.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:28.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:28.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:28.567+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:29.213 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:29.207+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:29.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:29.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:30.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:30.199+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:30.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:30.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:31.211 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:31.203+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:31.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:31.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:32.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:32.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:32.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:32.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:33.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:33.142+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:33.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:33.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:34.185 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:34.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:34.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:34.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:35.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:35.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:35.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:35.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:36.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:36.142+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:36.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:36.578+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:37.121 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:37.114+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:37.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:37.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:38.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:38.094+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:38.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:38.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:39.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:39.122+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:39.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:39.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:40.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:40.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:40.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:40.602+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:41.096 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:41.090+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:41.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:41.618+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:42.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:42.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:42.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:42.610+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:43.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:43.110+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:43.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:43.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:44.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:44.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:44.636 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:44.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:45.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:45.106+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:45.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:45.634+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:46.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:46.142+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:46.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:46.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:47.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:47.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:47.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:47.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:48.203 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:48.198+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:48.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:48.658+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:49.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:49.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:49.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:49.658+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:50.145 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:50.138+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:50.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:50.618+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:51.171 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:51.162+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:51.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:51.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:52.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:52.146+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:52.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:52.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:53.188 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:53.182+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:53.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:53.602+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:54.180 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:54.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:54.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:54.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:55.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:55.186+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:55.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:55.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:56.176 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:56.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:56.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:56.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:57.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:57.198+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:57.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:57.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:58.210 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:58.202+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:58.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:58.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:59.205 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:57:59.198+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:57:59.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:57:59.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:00.166 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:00.158+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:00.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:00.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:01.215 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:01.206+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:01.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:01.578+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:02.233 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:02.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:02.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:02.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:03.196 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:03.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:03.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:03.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:04.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:04.194+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:04.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:04.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:05.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:05.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:05.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:05.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:06.133 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:06.126+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:06.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:06.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:07.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:07.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:07.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:07.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:08.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:08.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:08.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:08.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:09.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:09.142+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:09.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:09.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:10.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:10.186+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:10.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:10.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:11.242 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:11.234+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:11.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:11.610+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:12.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:12.262+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:12.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:12.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:13.292 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:13.286+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:13.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:13.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:14.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:14.270+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:14.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:14.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:15.260 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:15.254+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:15.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:15.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:16.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:16.274+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:16.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:16.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:17.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:17.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:17.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:17.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:18.248 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:18.241+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:18.673 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:18.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:19.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:19.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:19.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:19.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:20.246 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:20.237+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:20.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:20.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:21.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:21.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:21.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:21.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:22.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:22.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:22.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:22.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:23.224 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:23.217+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:23.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:23.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:24.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:24.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:24.643 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:24.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:25.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:25.133+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:25.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:25.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:26.164 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:26.161+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:26.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:26.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:27.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:27.153+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:27.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:27.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:28.194 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:28.181+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:28.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:28.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:29.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:29.197+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:29.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:29.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:30.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:30.153+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:30.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:30.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:31.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:31.145+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:31.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:31.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:32.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:32.153+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:32.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:32.597+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:33.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:33.145+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:33.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:33.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:34.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:34.185+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:34.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:34.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:35.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:35.157+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:35.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:35.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:36.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:36.153+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:36.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:36.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:37.180 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:37.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:37.697 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:37.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:38.193 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:38.189+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:38.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:38.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:39.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:39.233+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:39.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:39.657+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:40.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:40.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:40.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:40.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:41.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:41.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:41.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:41.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:42.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:42.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:42.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:42.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:43.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:43.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:43.715 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:43.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:44.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:44.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:44.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:44.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:45.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:45.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:45.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:45.653+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:46.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:46.297+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:46.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:46.653+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:47.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:47.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:47.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:47.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:48.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:48.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:48.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:48.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:49.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:49.305+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:49.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:49.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:50.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:50.333+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:50.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:50.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:51.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:51.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:51.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:51.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:52.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:52.401+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:52.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:52.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:53.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:53.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:53.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:53.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:54.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:54.353+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:54.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:54.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:55.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:55.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:55.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:55.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:56.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:56.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:56.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:56.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:57.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:57.337+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:57.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:57.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:58.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:58.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:58.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:58.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:59.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:58:59.349+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:58:59.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:58:59.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:00.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:00.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:00.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:00.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:01.327 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:01.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:01.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:01.657+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:02.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:02.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:02.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:02.644+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:03.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:03.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:03.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:03.680+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:04.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:04.288+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:04.725 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:04.720+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:05.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:05.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:05.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:05.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:06.262 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:06.256+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:06.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:06.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:07.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:07.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:07.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:07.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:08.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:08.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:08.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:08.716+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:09.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:09.304+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:09.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:09.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:10.276 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:10.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:10.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:10.664+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:11.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:11.316+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:11.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:11.664+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:12.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:12.332+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:12.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:12.684+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:13.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:13.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:13.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:13.696+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:14.333 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:14.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:14.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:14.696+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:15.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:15.364+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:15.721 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:15.716+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:16.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:16.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:16.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:16.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:17.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:17.404+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:17.664 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:17.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:18.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:18.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:18.656 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:18.652+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:19.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:19.500+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:19.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:19.664+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:20.464 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:20.460+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:20.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:20.712+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:21.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:21.460+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:21.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:21.688+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:22.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:22.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:22.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:22.728+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:23.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:23.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:23.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:23.720+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:24.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:24.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:24.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:24.680+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:25.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:25.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:25.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:25.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:26.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:26.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:26.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:26.672+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:27.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:27.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:27.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:27.656+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:28.460 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:28.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:28.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:28.668+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:29.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:29.492+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:29.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:29.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:30.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:30.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:30.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:30.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:31.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:31.404+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:31.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:31.604+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:32.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:32.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:32.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:32.640+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:33.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:33.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:33.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:33.656+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:34.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:34.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:34.656 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:34.652+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:35.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:35.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:35.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:35.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:36.442 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:36.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:36.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:36.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:37.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:37.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:37.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:37.736+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:38.519 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:38.512+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:38.782 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:38.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:39.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:39.556+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:39.815 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:39.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:40.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:40.604+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:40.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:40.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:41.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:41.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:41.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:41.784+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:42.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:42.572+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:42.776 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:42.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:43.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:43.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:43.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:43.804+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:44.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:44.572+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:44.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:44.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:45.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:45.568+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:45.884 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:45.880+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:46.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:46.536+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:46.878 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:46.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:47.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:47.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:47.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:47.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:48.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:48.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:48.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:48.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:49.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:49.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:49.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:49.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:50.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:50.547+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:50.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:50.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:51.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:51.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:51.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:51.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:52.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:52.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:52.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:52.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:53.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:53.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:53.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:53.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:54.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:54.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:54.799 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:54.795+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:55.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:55.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:55.805 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:55.799+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:56.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:56.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:56.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:56.811+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:57.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:57.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:57.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:57.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:58.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:58.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:58.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:58.791+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:59.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T09:59:59.763+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T09:59:59.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T09:59:59.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:00.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:00.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:00.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:00.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:01.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:01.759+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:01.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:01.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:02.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:02.779+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:02.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:02.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:03.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:03.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:03.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:03.859+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:04.780 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:04.775+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:04.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:04.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:05.789 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:05.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:05.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:05.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:06.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:06.803+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:06.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:06.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:07.857 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:07.851+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:07.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:07.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:08.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:08.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:08.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:08.911+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:09.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:09.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:09.907 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:09.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:10.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:10.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:10.915 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:10.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:11.896 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:11.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:11.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:11.959+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:12.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:12.915+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:12.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:12.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:13.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:13.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:13.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:13.963+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:14.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:14.907+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:14.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:14.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:15.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:15.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:15.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:15.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:16.939 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:16.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:16.957 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:16.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:17.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:17.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:17.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:17.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:18.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:18.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:19.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:18.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:20.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:19.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:20.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:20.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:20.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:20.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:21.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:21.011+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:21.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:21.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:22.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:22.011+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:22.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:22.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:22.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:22.979+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:23.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:23.911+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:23.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:23.979+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:24.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:24.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:25.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:24.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:25.997 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:25.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:26.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:25.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:27.026 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:27.019+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:27.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:27.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:28.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:28.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:28.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:28.071+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:29.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:29.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:29.128 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:29.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:30.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:30.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:30.167 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:30.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:30.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:30.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:31.194 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:31.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:31.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:31.979+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:32.192 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:32.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:32.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:32.930+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:33.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:33.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:33.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:33.938+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:34.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:34.218+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:34.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:34.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:35.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:35.206+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:36.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:36.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:36.221 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:36.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:36.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:36.982+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:37.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:37.230+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:37.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:37.986+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:38.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:38.282+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:39.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:38.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:39.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:39.322+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:39.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:39.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:40.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:40.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:40.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:40.958+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:41.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:41.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:41.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:41.930+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:42.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:42.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:42.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:42.958+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:43.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:43.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:44.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:44.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:44.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:44.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:45.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:45.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:45.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:45.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:46.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:46.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:46.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:46.490+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:47.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:47.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:47.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:47.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:48.037 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:48.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:48.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:48.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:49.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:49.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:49.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:49.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:50.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:49.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:50.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:50.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:50.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:50.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:51.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:51.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:51.956 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:51.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:52.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:52.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:52.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:52.942+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:53.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:53.662+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:53.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:53.910+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:54.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:54.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:54.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:54.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:55.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:55.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:55.963 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:55.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:56.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:56.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:56.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:56.966+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:57.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:57.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:58.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:57.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:58.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:58.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:59.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:00:59.014+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:00:59.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:00:59.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:00.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:00.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:00.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:00.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:01.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:01.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:01.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:01.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:01.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:01.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:02.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:02.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:02.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:02.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:03.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:03.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:04.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:04.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:04.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:04.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:04.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:04.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:05.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:05.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:05.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:05.946+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:06.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:06.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:06.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:06.938+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:07.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:07.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:07.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:07.926+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:08.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:08.614+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:08.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:08.918+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:09.595 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:09.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:09.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:09.882+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:10.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:10.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:10.884 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:10.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:11.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:11.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:11.874 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:11.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:12.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:12.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:12.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:12.918+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:13.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:13.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:13.956 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:13.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:14.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:14.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:14.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:14.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:15.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:15.534+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:15.928 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:15.922+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:16.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:16.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:16.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:16.950+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:17.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:17.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:17.918 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:17.909+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:18.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:18.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:18.911 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:18.901+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:19.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:19.665+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:19.895 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:19.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:20.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:20.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:20.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:20.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:21.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:21.681+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:21.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:21.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:22.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:22.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:22.881 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:22.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:23.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:23.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:23.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:23.861+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:24.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:24.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:24.882 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:24.877+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:25.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:25.765+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:25.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:25.853+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:26.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:26.805+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:26.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:26.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:27.848 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:27.845+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:27.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:27.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:28.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:28.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:28.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:28.833+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:29.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:29.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:29.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:29.869+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:30.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:30.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:30.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:30.837+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:31.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:31.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:31.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:31.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:32.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:32.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:32.853 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:32.849+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:33.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:33.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:33.870 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:33.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:34.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:34.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:34.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:34.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:35.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:35.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:35.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:35.845+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:36.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:36.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:36.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:36.853+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:37.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:37.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:37.884 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:37.881+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:38.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:38.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:38.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:38.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:39.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:39.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:39.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:39.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:40.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:40.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:40.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:40.917+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:41.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:41.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:41.952 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:41.949+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:42.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:42.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:42.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:42.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:43.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:43.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:43.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:43.913+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:44.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:44.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:44.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:44.885+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:45.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:45.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:45.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:45.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:46.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:46.685+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:46.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:46.913+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:47.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:47.641+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:47.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:47.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:48.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:48.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:48.954 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:48.949+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:49.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:49.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:49.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:49.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:50.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:50.661+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:51.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:51.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:51.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:51.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:52.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:52.081+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:52.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:52.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:53.114 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:53.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:53.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:53.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:54.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:54.073+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:54.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:54.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:55.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:55.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:55.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:55.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:56.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:56.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:56.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:56.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:56.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:56.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:57.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:57.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:58.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:58.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:58.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:58.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:58.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:01:58.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:01:59.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:01:59.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:00.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:00.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:00.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:00.685+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:01.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:01.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:01.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:01.665+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:02.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:02.001+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:02.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:02.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:03.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:03.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:03.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:03.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:04.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:04.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:04.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:04.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:05.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:05.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:05.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:05.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:06.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:06.088+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:06.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:06.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:07.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:07.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:07.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:07.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:08.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:08.068+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:08.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:08.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:09.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:09.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:09.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:09.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:10.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:10.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:10.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:10.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:11.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:11.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:11.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:11.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:12.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:12.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:12.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:12.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:13.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:13.196+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:13.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:13.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:14.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:14.196+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:14.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:14.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:15.184 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:15.180+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:15.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:15.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:16.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:16.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:16.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:16.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:17.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:17.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:17.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:17.716+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:18.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:18.140+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:18.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:18.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:19.122 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:19.116+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:19.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:19.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:20.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:20.140+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:20.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:20.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:21.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:21.108+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:21.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:21.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:22.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:22.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:22.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:22.564+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:23.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:23.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:23.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:23.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:24.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:24.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:24.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:24.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:25.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:25.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:25.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:25.616+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:26.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:26.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:26.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:26.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:27.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:27.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:27.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:27.612+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:28.067 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:28.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:28.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:28.592+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:29.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:29.072+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:29.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:29.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:30.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:30.120+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:30.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:30.552+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:31.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:31.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:31.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:31.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:32.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:32.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:32.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:32.556+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:33.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:33.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:33.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:33.556+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:34.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:34.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:34.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:34.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:35.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:35.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:35.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:35.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:36.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:36.108+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:36.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:36.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:37.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:37.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:37.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:37.604+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:38.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:38.120+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:38.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:38.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:39.178 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:39.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:39.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:39.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:40.155 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:40.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:40.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:40.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:41.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:41.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:41.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:41.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:42.104 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:42.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:42.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:42.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:43.138 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:43.132+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:43.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:43.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:44.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:44.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:44.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:44.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:45.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:45.108+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:45.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:45.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:46.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:46.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:46.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:46.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:47.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:47.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:47.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:47.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:48.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:48.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:48.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:48.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:49.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:49.071+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:49.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:49.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:50.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:50.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:50.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:50.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:51.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:51.095+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:51.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:51.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:52.132 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:52.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:52.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:52.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:53.109 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:53.103+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:53.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:53.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:54.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:54.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:54.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:54.559+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:55.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:55.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:55.557 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:55.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:56.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:56.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:56.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:56.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:57.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:57.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:57.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:57.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:58.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:58.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:58.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:58.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:59.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:02:59.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:02:59.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:02:59.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:00.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:00.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:00.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:00.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:01.085 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:01.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:01.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:01.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:02.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:02.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:02.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:02.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:03.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:03.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:03.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:03.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:04.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:04.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:04.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:04.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:05.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:05.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:05.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:05.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:06.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:06.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:06.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:06.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:07.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:07.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:07.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:07.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:08.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:08.047+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:08.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:08.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:09.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:09.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:09.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:09.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:10.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:10.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:10.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:10.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:11.122 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:11.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:11.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:11.695+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:12.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:12.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:12.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:12.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:13.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:13.179+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:13.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:13.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:14.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:14.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:14.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:14.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:15.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:15.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:15.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:15.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:16.286 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:16.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:16.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:16.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:17.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:17.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:17.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:17.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:18.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:18.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:18.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:18.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:19.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:19.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:19.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:19.691+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:20.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:20.327+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:20.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:20.655+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:21.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:21.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:21.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:21.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:22.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:22.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:22.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:22.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:23.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:23.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:23.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:23.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:24.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:24.339+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:24.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:24.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:25.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:25.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:25.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:25.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:26.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:26.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:26.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:26.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:27.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:27.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:27.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:27.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:28.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:28.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:28.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:28.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:29.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:29.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:29.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:29.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:30.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:30.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:30.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:30.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:31.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:31.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:31.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:31.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:32.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:32.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:32.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:32.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:33.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:33.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:33.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:33.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:34.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:34.298+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:34.645 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:34.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:35.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:35.314+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:35.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:35.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:36.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:36.342+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:36.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:36.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:37.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:37.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:37.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:37.662+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:38.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:38.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:38.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:38.694+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:39.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:39.450+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:39.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:39.658+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:40.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:40.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:40.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:40.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:41.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:41.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:41.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:41.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:42.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:42.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:42.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:42.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:43.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:43.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:43.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:43.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:44.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:44.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:44.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:44.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:45.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:45.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:45.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:45.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:46.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:46.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:46.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:46.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:47.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:47.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:47.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:47.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:48.349 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:48.342+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:48.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:48.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:49.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:49.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:49.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:49.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:50.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:50.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:50.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:50.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:51.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:51.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:51.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:51.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:52.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:52.326+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:52.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:52.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:53.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:53.306+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:53.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:53.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:54.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:54.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:54.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:54.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:55.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:55.314+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:55.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:55.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:56.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:56.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:56.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:56.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:57.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:57.334+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:57.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:57.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:58.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:58.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:58.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:58.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:59.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:03:59.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:03:59.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:03:59.514+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:00.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:00.378+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:00.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:00.482+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:01.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:01.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:01.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:01.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:02.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:02.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:02.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:02.518+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:03.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:03.286+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:03.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:03.522+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:04.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:04.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:04.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:04.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:05.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:05.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:05.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:05.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:06.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:06.314+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:06.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:06.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:07.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:07.334+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:07.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:07.522+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:08.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:08.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:08.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:08.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:09.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:09.326+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:09.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:09.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:10.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:10.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:10.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:10.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:11.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:11.290+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:11.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:11.466+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:12.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:12.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:12.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:12.466+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:13.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:13.342+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:13.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:13.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:14.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:14.370+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:14.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:14.514+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:15.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:15.366+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:15.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:15.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:16.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:16.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:16.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:16.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:17.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:17.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:17.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:17.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:18.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:18.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:18.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:18.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:19.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:19.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:19.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:19.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:20.366 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:20.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:20.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:20.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:21.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:21.374+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:21.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:21.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:22.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:22.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:22.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:22.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:23.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:23.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:23.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:23.553+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:24.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:24.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:24.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:24.573+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:25.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:25.301+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:25.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:25.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:26.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:26.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:26.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:26.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:27.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:27.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:27.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:27.585+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:28.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:28.357+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:28.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:28.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:29.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:29.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:29.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:29.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:30.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:30.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:30.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:30.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:31.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:31.425+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:31.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:31.605+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:32.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:32.445+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:32.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:32.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:33.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:33.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:33.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:33.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:34.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:34.465+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:34.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:34.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:35.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:35.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:35.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:35.601+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:36.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:36.465+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:36.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:36.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:37.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:37.473+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:37.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:37.573+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:38.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:38.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:38.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:38.573+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:39.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:39.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:39.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:39.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:40.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:40.573+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:40.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:40.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:41.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:41.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:41.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:41.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:42.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:42.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:42.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:42.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:43.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:43.589+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:43.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:43.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:44.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:44.573+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:44.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:44.649+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:45.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:45.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:45.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:45.689+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:46.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:46.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:46.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:46.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:47.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:47.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:47.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:47.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:48.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:48.553+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:48.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:48.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:49.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:49.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:49.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:49.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:50.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:50.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:50.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:50.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:51.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:51.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:51.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:51.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:52.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:52.569+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:52.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:52.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:53.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:53.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:53.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:53.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:54.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:54.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:54.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:54.689+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:55.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:55.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:55.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:55.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:56.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:56.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:56.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:56.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:57.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:57.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:57.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:57.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:58.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:58.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:58.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:58.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:59.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:04:59.661+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:04:59.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:04:59.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:00.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:00.653+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:00.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:00.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:01.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:01.605+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:01.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:01.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:02.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:02.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:02.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:02.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:03.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:03.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:03.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:03.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:04.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:04.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:04.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:04.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:05.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:05.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:05.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:05.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:06.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:06.653+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:06.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:06.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:07.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:07.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:07.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:07.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:08.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:08.661+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:08.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:08.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:09.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:09.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:09.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:09.688+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:10.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:10.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:10.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:10.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:11.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:11.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:11.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:11.640+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:12.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:12.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:12.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:12.652+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:13.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:13.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:13.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:13.700+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:14.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:14.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:14.755 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:14.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:15.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:15.592+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:15.764 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:15.760+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:16.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:16.564+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:16.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:16.728+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:17.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:17.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:17.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:17.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:18.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:18.612+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:18.761 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:18.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:19.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:19.636+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:19.799 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:19.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:20.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:20.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:20.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:20.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:21.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:21.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:21.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:21.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:22.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:22.604+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:22.896 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:22.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:23.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:23.648+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:23.909 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:23.904+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:24.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:24.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:24.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:24.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:25.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:25.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:25.844 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:25.840+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:26.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:26.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:26.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:26.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:27.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:27.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:27.799 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:27.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:28.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:28.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:28.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:28.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:29.715 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:29.708+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:29.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:29.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:30.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:30.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:30.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:30.720+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:31.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:31.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:31.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:31.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:32.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:32.704+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:32.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:32.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:33.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:33.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:33.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:33.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:34.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:34.636+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:34.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:34.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:35.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:35.608+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:35.883 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:35.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:36.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:36.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:36.932 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:36.928+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:37.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:37.604+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:37.969 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:37.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:38.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:38.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:38.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:38.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:39.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:39.612+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:40.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:40.012+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:40.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:40.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:41.037 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:41.032+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:41.632 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:41.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:42.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:42.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:42.645 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:42.640+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:43.005 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:43.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:43.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:43.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:44.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:44.024+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:44.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:44.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:44.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:44.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:45.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:45.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:45.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:45.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:46.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:46.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:46.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:46.928+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:47.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:47.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:47.966 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:47.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:48.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:48.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:48.944 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:48.940+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:49.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:49.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:49.979 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:49.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:50.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:50.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:50.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:50.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:51.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:51.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:51.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:51.944+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:52.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:52.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:52.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:52.952+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:53.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:53.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:53.943 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:53.936+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:54.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:54.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:54.923 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:54.920+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:55.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:55.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:55.930 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:55.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:56.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:56.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:56.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:56.975+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:57.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:57.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:57.953 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:57.947+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:58.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:58.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:58.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:58.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:59.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:05:59.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:05:59.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:05:59.939+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:00.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:00.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:00.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:00.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:01.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:01.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:01.973 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:01.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:02.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:02.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:03.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:03.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:03.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:03.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:03.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:03.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:04.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:04.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:05.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:04.999+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:05.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:05.815+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:05.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:05.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:06.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:06.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:06.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:06.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:07.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:07.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:07.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:07.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:08.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:08.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:08.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:08.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:09.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:09.815+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:09.956 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:09.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:10.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:10.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:10.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:10.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:11.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:11.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:11.927 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:11.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:12.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:12.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:12.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:12.883+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:13.879 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:13.875+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:13.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:13.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:14.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:14.915+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:14.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:14.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:15.965 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:15.959+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:15.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:15.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:16.960 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:16.951+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:16.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:16.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:17.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:17.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:18.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:18.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:19.006 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:18.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:19.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:19.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:19.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:19.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:20.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:20.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:20.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:20.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:21.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:21.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:21.978 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:21.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:22.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:22.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:22.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:22.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:23.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:23.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:24.011 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:24.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:24.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:24.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:25.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:25.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:25.055 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:25.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:26.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:26.051+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:26.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:26.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:27.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:27.075+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:27.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:27.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:28.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:28.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:28.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:28.099+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:29.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:29.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:29.153 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:29.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:30.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:30.095+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:30.205 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:30.199+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:31.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:31.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:31.254 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:31.247+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:32.108 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:32.103+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:32.241 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:32.235+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:33.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:33.103+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:33.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:33.271+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:34.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:34.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:34.262 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:34.255+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:35.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:35.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:35.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:35.299+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:36.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:36.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:36.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:36.283+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:37.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:37.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:37.307 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:37.299+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:38.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:38.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:38.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:38.307+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:39.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:39.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:39.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:39.339+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:40.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:40.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:40.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:40.355+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:41.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:41.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:41.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:41.395+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:42.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:42.059+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:42.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:42.403+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:43.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:43.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:43.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:43.407+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:44.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:44.118+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:44.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:44.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:45.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:45.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:45.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:45.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:46.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:46.114+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:46.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:46.366+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:47.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:47.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:47.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:47.362+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:48.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:48.098+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:48.410 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:48.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:49.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:49.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:49.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:49.374+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:50.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:50.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:50.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:50.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:51.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:51.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:51.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:51.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:52.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:52.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:52.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:52.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:53.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:53.138+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:53.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:53.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:54.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:54.146+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:54.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:54.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:55.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:55.110+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:55.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:55.386+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:56.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:56.122+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:56.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:56.366+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:57.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:57.138+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:57.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:57.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:58.108 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:58.102+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:58.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:58.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:59.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:06:59.098+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:06:59.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:06:59.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:00.068 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:00.062+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:00.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:00.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:01.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:01.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:01.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:01.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:02.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:02.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:02.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:02.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:03.074 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:03.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:03.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:03.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:04.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:04.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:04.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:04.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:05.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:05.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:05.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:05.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:06.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:06.086+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:06.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:06.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:07.142 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:07.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:07.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:07.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:08.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:08.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:08.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:08.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:09.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:09.106+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:09.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:09.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:10.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:10.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:10.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:10.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:11.053 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:11.046+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:11.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:11.330+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:12.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:12.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:12.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:12.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:13.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:13.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:13.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:13.306+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:14.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:14.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:14.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:14.322+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:15.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:15.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:15.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:15.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:16.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:16.062+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:16.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:16.366+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:17.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:17.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:17.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:17.374+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:18.104 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:18.098+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:18.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:18.330+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:19.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:19.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:19.337 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:19.330+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:20.084 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:20.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:20.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:20.366+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:21.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:21.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:21.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:21.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:22.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:22.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:22.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:22.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:23.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:23.086+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:23.340 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:23.334+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:24.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:24.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:24.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:24.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:25.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:25.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:25.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:25.386+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:26.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:26.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:26.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:26.434+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:27.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:27.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:27.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:27.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:27.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:27.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:28.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:28.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:29.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:29.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:29.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:29.398+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:30.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:30.034+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:30.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:30.362+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:31.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:31.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:31.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:31.381+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:32.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:32.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:32.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:32.349+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:33.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:33.117+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:33.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:33.337+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:34.133 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:34.125+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:34.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:34.305+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:35.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:35.165+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:35.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:35.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:36.187 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:36.181+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:36.337 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:36.329+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:37.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:37.209+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:37.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:37.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:38.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:38.217+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:38.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:38.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:39.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:39.209+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:39.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:39.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:40.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:40.201+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:40.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:40.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:41.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:41.197+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:41.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:41.297+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:42.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:42.153+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:42.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:42.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:43.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:43.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:43.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:43.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:44.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:44.137+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:44.239 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:44.237+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:45.167 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:45.161+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:45.252 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:45.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:46.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:46.157+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:46.216 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:46.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:47.172 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:47.169+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:47.207 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:47.201+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:48.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:48.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:48.239 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:48.237+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:49.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:49.233+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:49.273 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:49.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:50.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:50.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:50.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:50.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:51.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:51.209+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:51.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:51.257+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:52.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:52.197+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:52.251 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:52.245+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:53.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:53.213+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:53.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:53.265+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:54.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:54.201+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:54.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:54.277+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:55.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:55.201+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:55.260 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:55.257+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:56.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:56.185+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:56.264 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:56.261+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:57.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:57.149+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:57.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:57.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:58.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:58.197+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:58.210 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:58.205+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:59.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:07:59.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:07:59.247 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:07:59.245+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:00.231 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:00.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:00.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:00.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:01.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:01.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:01.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:01.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:02.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:02.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:02.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:02.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:03.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:03.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:03.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:03.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:04.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:04.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:04.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:04.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:05.245 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:05.241+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:05.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:05.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:06.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:06.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:06.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:06.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:07.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:07.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:07.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:07.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:08.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:08.289+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:08.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:08.333+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:09.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:09.261+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:09.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:09.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:10.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:10.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:10.392 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:10.389+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:11.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:11.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:11.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:11.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:12.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:12.257+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:12.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:12.465+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:13.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:13.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:13.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:13.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:14.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:14.201+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:14.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:14.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:15.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:15.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:15.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:15.465+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:16.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:16.261+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:16.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:16.489+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:17.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:17.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:17.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:17.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:18.212 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:18.209+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:18.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:18.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:19.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:19.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:19.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:19.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:20.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:20.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:20.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:20.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:21.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:21.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:21.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:21.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:22.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:22.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:22.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:22.628+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:23.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:23.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:23.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:23.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:24.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:24.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:24.609 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:24.604+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:25.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:25.192+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:25.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:25.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:26.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:26.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:26.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:26.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:27.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:27.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:27.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:27.552+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:28.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:28.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:28.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:28.604+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:29.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:29.304+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:29.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:29.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:30.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:30.352+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:30.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:30.548+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:31.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:31.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:31.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:31.532+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:32.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:32.320+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:32.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:32.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:33.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:33.316+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:33.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:33.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:34.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:34.328+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:34.579 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:34.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:35.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:35.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:35.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:35.544+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:36.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:36.368+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:36.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:36.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:37.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:37.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:37.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:37.592+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:38.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:38.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:38.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:38.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:39.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:39.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:39.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:39.640+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:40.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:40.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:40.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:40.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:41.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:41.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:41.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:41.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:42.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:42.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:42.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:42.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:43.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:43.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:43.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:43.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:44.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:44.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:44.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:44.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:45.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:45.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:45.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:45.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:46.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:46.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:46.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:46.648+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:47.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:47.248+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:47.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:47.648+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:48.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:48.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:48.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:48.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:49.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:49.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:49.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:49.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:50.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:50.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:50.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:50.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:51.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:51.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:51.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:51.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:52.325 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:52.320+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:52.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:52.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:53.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:53.316+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:53.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:53.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:54.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:54.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:54.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:54.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:55.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:55.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:55.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:55.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:56.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:56.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:56.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:56.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:57.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:57.364+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:57.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:57.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:58.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:58.332+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:58.880 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:58.876+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:59.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:08:59.368+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:08:59.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:08:59.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:00.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:00.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:00.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:00.932+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:01.349 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:01.344+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:01.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:01.976+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:02.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:02.304+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:02.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:02.976+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:03.303 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:03.296+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:03.999 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:03.992+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:04.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:04.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:04.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:04.948+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:05.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:05.332+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:05.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:05.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:06.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:06.375+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:06.927 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:06.919+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:07.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:07.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:07.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:07.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:08.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:08.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:08.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:08.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:09.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:09.455+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:09.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:09.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:10.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:10.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:10.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:10.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:11.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:11.423+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:11.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:11.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:12.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:12.387+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:12.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:12.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:13.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:13.407+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:13.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:13.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:14.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:14.375+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:14.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:14.823+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:15.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:15.363+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:15.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:15.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:16.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:16.391+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:16.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:16.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:17.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:17.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:17.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:17.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:18.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:18.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:18.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:18.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:19.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:19.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:19.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:19.919+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:20.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:20.439+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:20.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:20.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:21.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:21.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:21.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:21.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:22.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:22.411+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:23.001 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:22.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:23.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:23.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:24.019 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:24.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:24.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:24.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:24.981 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:24.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:25.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:25.547+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:25.997 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:25.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:26.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:26.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:27.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:27.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:27.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:27.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:27.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:27.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:28.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:28.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:28.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:28.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:29.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:29.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:29.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:29.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:30.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:30.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:30.918 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:30.911+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:31.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:31.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:31.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:31.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:32.547 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:32.539+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:32.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:32.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:33.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:33.563+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:33.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:33.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:34.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:34.579+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:34.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:34.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:35.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:35.587+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:36.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:35.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:36.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:36.583+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:36.973 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:36.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:37.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:37.603+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:37.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:37.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:38.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:38.555+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:38.888 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:38.883+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:39.583 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:39.579+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:39.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:39.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:40.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:40.579+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:40.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:40.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:41.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:41.611+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:41.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:41.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:42.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:42.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:42.964 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:42.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:43.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:43.655+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:43.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:43.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:44.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:44.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:44.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:44.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:45.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:45.615+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:45.997 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:45.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:46.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:46.599+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:46.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:46.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:47.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:47.563+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:47.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:47.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:48.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:48.583+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:48.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:48.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:49.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:49.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:49.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:49.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:50.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:50.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:50.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:50.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:51.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:51.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:51.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:51.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:52.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:52.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:52.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:52.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:53.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:53.514+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:53.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:53.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:54.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:54.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:54.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:54.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:55.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:55.450+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:55.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:55.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:56.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:56.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:56.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:56.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:57.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:57.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:57.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:57.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:58.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:58.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:58.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:58.834+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:59.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:09:59.418+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:09:59.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:09:59.818+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:00.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:00.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:00.867 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:00.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:01.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:01.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:01.857 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:01.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:02.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:02.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:02.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:02.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:03.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:03.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:03.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:03.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:04.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:04.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:04.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:04.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:05.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:05.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:05.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:05.822+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:06.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:06.378+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:06.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:06.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:07.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:07.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:07.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:07.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:08.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:08.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:08.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:08.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:09.375 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:09.366+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:09.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:09.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:10.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:10.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:10.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:10.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:11.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:11.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:11.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:11.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:12.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:12.370+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:12.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:12.814+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:13.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:13.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:13.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:13.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:14.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:14.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:14.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:14.854+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:15.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:15.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:15.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:15.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:16.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:16.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:16.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:16.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:17.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:17.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:17.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:17.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:18.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:18.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:18.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:18.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:19.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:19.522+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:19.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:19.766+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:20.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:20.514+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:20.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:20.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:21.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:21.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:21.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:21.766+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:22.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:22.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:22.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:22.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:23.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:23.450+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:23.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:23.774+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:24.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:24.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:24.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:24.766+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:25.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:25.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:25.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:25.782+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:26.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:26.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:26.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:26.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:27.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:27.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:27.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:27.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:28.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:28.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:28.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:28.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:29.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:29.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:29.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:29.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:30.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:30.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:30.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:30.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:31.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:31.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:31.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:31.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:32.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:32.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:32.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:32.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:33.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:33.450+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:33.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:33.914+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:34.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:34.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:34.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:34.918+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:35.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:35.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:35.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:35.962+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:36.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:36.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:36.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:36.966+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:37.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:37.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:37.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:37.974+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:38.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:38.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:38.946 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:38.938+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:39.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:39.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:39.945 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:39.937+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:40.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:40.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:40.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:40.953+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:41.480 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:41.473+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:41.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:41.917+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:42.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:42.485+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:42.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:42.953+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:43.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:43.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:43.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:43.965+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:44.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:44.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:44.998 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:44.993+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:45.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:45.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:46.030 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:46.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:46.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:46.633+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:47.046 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:47.041+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:47.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:47.633+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:48.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:48.089+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:48.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:48.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:49.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:49.069+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:49.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:49.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:50.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:50.069+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:50.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:50.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:51.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:51.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:51.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:51.589+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:52.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:52.013+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:52.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:52.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:52.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:52.969+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:53.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:53.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:53.991 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:53.989+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:54.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:54.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:55.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:55.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:55.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:55.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:56.062 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:56.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:56.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:56.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:57.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:57.101+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:57.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:57.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:58.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:58.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:58.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:58.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:59.119 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:10:59.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:10:59.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:10:59.529+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:00.099 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:00.093+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:00.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:00.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:01.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:01.093+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:01.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:01.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:02.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:02.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:02.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:02.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:03.023 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:03.017+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:03.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:03.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:04.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:04.017+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:04.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:04.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:05.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:05.001+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:05.491 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:05.485+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:06.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:06.001+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:06.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:06.445+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:06.984 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:06.981+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:07.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:07.481+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:07.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:07.949+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:08.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:08.469+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:08.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:08.929+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:09.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:09.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:09.977 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:09.973+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:10.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:10.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:10.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:10.969+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:11.472 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:11.469+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:12.012 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:12.009+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:12.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:12.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:13.061 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:13.057+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:13.500 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:13.497+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:14.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:14.037+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:14.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:14.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:15.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:15.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:15.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:15.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:15.989 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:15.985+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:16.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:16.537+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:16.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:16.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:17.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:17.537+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:17.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:17.961+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:18.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:18.489+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:18.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:18.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:19.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:19.485+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:19.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:19.957+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:20.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:20.465+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:20.919 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:20.913+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:21.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:21.441+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:21.939 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:21.933+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:22.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:22.465+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:22.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:22.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:23.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:23.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:23.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:23.881+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:24.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:24.489+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:24.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:24.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:25.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:25.497+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:25.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:25.977+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:26.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:26.492+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:26.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:26.948+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:27.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:27.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:27.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:27.956+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:28.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:28.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:28.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:28.956+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:29.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:29.432+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:29.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:29.968+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:30.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:30.440+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:31.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:30.996+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:31.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:31.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:31.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:31.972+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:32.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:32.412+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:33.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:32.996+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:33.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:33.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:33.998 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:33.992+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:34.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:34.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:35.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:35.036+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:35.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:35.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:36.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:36.052+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:36.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:36.352+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:37.084 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:37.080+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:37.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:37.332+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:38.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:38.036+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:38.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:38.352+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:39.038 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:39.032+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:39.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:39.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:40.054 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:40.048+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:40.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:40.376+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:41.013 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:41.008+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:41.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:41.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:42.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:42.036+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:42.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:42.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:43.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:43.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:43.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:43.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:44.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:44.108+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:44.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:44.328+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:45.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:45.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:45.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:45.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:46.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:46.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:46.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:46.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:47.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:47.144+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:47.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:47.368+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:48.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:48.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:48.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:48.328+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:49.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:49.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:49.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:49.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:50.133 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:50.128+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:50.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:50.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:51.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:51.112+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:51.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:51.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:52.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:52.156+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:52.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:52.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:53.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:53.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:53.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:53.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:54.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:54.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:54.288 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:54.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:55.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:55.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:55.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:55.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:56.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:56.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:56.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:56.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:57.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:57.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:57.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:57.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:58.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:58.112+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:58.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:58.316+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:59.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:11:59.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:11:59.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:11:59.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:00.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:00.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:00.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:00.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:01.118 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:01.112+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:01.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:01.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:02.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:02.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:02.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:02.372+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:03.146 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:03.140+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:03.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:03.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:04.139 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:04.136+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:04.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:04.360+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:05.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:05.104+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:05.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:05.352+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:06.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:06.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:06.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:06.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:07.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:07.064+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:07.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:07.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:08.029 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:08.024+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:08.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:08.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:09.016 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:09.012+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:09.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:09.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:10.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:10.028+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:10.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:10.360+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:11.062 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:11.056+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:11.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:11.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:12.084 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:12.080+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:12.325 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:12.320+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:13.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:13.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:13.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:13.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:14.088 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:14.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:14.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:14.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:15.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:15.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:15.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:15.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:16.109 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:16.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:16.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:16.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:17.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:17.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:17.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:17.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:18.190 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:18.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:18.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:18.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:19.153 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:19.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:19.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:19.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:20.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:20.171+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:20.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:20.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:21.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:21.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:21.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:21.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:22.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:22.107+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:22.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:22.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:23.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:23.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:23.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:23.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:24.161 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:24.155+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:24.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:24.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:25.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:25.107+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:25.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:25.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:26.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:26.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:26.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:26.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:27.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:27.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:27.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:27.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:28.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:28.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:28.231 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:28.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:29.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:29.127+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:29.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:29.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:30.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:30.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:30.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:30.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:31.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:31.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:31.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:31.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:32.140 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:32.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:32.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:32.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:33.124 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:33.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:33.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:33.207+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:34.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:34.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:34.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:34.203+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:35.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:35.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:35.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:35.231+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:36.146 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:36.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:36.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:36.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:37.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:37.099+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:37.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:37.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:38.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:38.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:38.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:38.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:39.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:39.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:39.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:39.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:40.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:40.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:40.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:40.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:41.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:41.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:41.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:41.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:42.167 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:42.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:42.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:42.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:43.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:43.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:43.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:43.179+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:44.185 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:44.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:44.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:44.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:45.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:45.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:45.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:45.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:46.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:46.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:46.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:46.227+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:47.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:47.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:47.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:47.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:48.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:48.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:48.188 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:48.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:49.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:49.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:49.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:49.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:50.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:50.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:50.146 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:50.139+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:51.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:51.099+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:51.155 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:51.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:52.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:52.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:52.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:52.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:53.095 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:53.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:53.169 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:53.163+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:54.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:54.095+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:54.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:54.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:55.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:55.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:55.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:55.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:56.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:56.071+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:56.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:56.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:57.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:57.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:57.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:57.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:57.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:57.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:58.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:58.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:59.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:12:59.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:12:59.203 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:12:59.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:00.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:00.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:00.239 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:00.234+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:01.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:01.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:01.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:01.210+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:02.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:02.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:02.207 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:02.202+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:03.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:03.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:03.200 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:03.194+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:04.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:04.030+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:04.198 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:04.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:05.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:05.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:05.177 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:05.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:06.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:06.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:06.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:06.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:07.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:07.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:07.195 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:07.186+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:08.047 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:08.038+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:08.221 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:08.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:09.057 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:09.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:09.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:09.262+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:10.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:10.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:10.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:10.222+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:11.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:11.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:11.238 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:11.230+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:12.137 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:12.130+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:12.281 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:12.274+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:13.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:13.122+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:13.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:13.266+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:14.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:14.118+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:14.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:14.306+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:15.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:15.130+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:15.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:15.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:16.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:16.174+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:16.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:16.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:17.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:17.174+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:17.314 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:17.306+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:18.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:18.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:18.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:18.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:19.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:19.254+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:19.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:19.362+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:20.300 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:20.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:20.408 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:20.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:21.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:21.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:21.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:21.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:22.348 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:22.342+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:22.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:22.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:23.300 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:23.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:23.385 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:23.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:24.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:24.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:24.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:24.346+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:25.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:25.298+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:25.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:25.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:26.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:26.254+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:26.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:26.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:27.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:27.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:27.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:27.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:28.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:28.274+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:28.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:28.374+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:29.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:29.266+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:29.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:29.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:30.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:30.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:30.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:30.366+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:31.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:31.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:31.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:31.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:32.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:32.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:32.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:32.434+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:33.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:33.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:33.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:33.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:34.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:34.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:34.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:34.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:35.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:35.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:35.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:35.478+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:36.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:36.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:36.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:36.466+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:37.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:37.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:37.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:37.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:38.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:38.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:38.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:38.522+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:39.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:39.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:39.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:39.478+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:40.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:40.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:40.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:40.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:41.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:41.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:41.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:41.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:42.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:42.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:42.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:42.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:43.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:43.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:43.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:43.438+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:44.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:44.146+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:44.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:44.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:45.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:45.154+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:45.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:45.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:46.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:46.126+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:46.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:46.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:47.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:47.121+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:47.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:47.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:48.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:48.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:48.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:48.477+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:49.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:49.077+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:49.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:49.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:50.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:50.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:50.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:50.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:51.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:51.093+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:51.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:51.413+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:52.102 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:52.093+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:52.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:52.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:53.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:53.093+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:53.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:53.501+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:54.090 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:54.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:54.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:54.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:55.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:55.037+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:55.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:55.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:56.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:56.041+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:56.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:56.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:57.065 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:57.061+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:57.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:57.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:58.056 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:58.053+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:58.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:58.569+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:59.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:13:59.097+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:13:59.582 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:13:59.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:00.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:00.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:00.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:00.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:01.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:01.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:01.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:01.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:02.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:02.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:02.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:02.477+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:03.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:03.117+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:03.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:03.477+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:04.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:04.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:04.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:04.469+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:05.115 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:05.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:05.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:05.465+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:06.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:06.105+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:06.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:06.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:07.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:07.125+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:07.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:07.489+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:08.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:08.173+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:08.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:08.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:09.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:09.141+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:09.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:09.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:10.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:10.121+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:10.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:10.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:11.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:11.157+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:11.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:11.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:12.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:12.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:12.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:12.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:13.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:13.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:13.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:13.569+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:14.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:14.273+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:14.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:14.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:15.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:15.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:15.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:15.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:16.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:16.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:16.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:16.481+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:17.267 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:17.261+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:17.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:17.441+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:18.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:18.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:18.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:18.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:19.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:19.201+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:19.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:19.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:20.166 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:20.161+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:20.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:20.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:21.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:21.113+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:21.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:21.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:22.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:22.137+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:22.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:22.445+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:23.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:23.173+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:23.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:23.429+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:24.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:24.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:24.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:24.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:25.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:25.173+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:25.478 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:25.473+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:26.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:26.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:26.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:26.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:27.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:27.149+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:27.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:27.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:28.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:28.169+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:28.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:28.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:29.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:29.129+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:29.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:29.605+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:30.185 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:30.181+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:30.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:30.561+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:31.153 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:31.149+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:31.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:31.573+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:32.191 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:32.185+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:32.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:32.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:33.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:33.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:33.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:33.584+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:34.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:34.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:34.564 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:34.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:35.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:35.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:35.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:35.600+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:36.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:36.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:36.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:36.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:37.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:37.304+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:37.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:37.548+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:38.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:38.332+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:38.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:38.544+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:39.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:39.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:39.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:39.548+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:40.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:40.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:40.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:40.568+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:41.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:41.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:41.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:41.608+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:42.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:42.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:42.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:42.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:43.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:43.344+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:43.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:43.620+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:44.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:44.344+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:44.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:44.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:45.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:45.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:45.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:45.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:46.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:46.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:46.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:46.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:47.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:47.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:47.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:47.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:48.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:48.364+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:48.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:48.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:49.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:49.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:49.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:49.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:50.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:50.364+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:50.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:50.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:51.361 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:51.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:51.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:51.616+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:52.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:52.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:52.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:52.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:53.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:53.440+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:53.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:53.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:54.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:54.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:54.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:54.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:55.420 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:55.416+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:55.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:55.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:56.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:56.420+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:56.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:56.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:57.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:57.472+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:57.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:57.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:58.491 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:58.488+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:58.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:58.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:59.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:14:59.472+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:14:59.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:14:59.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:00.442 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:00.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:00.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:00.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:01.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:01.420+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:01.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:01.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:02.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:02.448+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:02.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:02.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:03.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:03.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:03.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:03.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:04.397 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:04.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:04.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:04.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:05.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:05.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:05.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:05.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:06.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:06.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:06.671 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:06.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:07.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:07.412+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:07.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:07.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:08.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:08.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:08.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:08.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:09.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:09.416+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:09.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:09.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:10.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:10.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:10.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:10.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:11.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:11.440+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:11.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:11.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:12.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:12.476+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:12.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:12.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:13.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:13.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:13.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:13.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:14.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:14.492+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:14.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:14.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:15.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:15.464+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:15.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:15.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:16.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:16.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:16.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:16.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:17.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:17.556+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:17.761 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:17.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:18.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:18.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:18.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:18.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:19.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:19.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:19.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:19.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:20.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:20.551+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:20.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:20.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:21.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:21.559+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:21.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:21.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:22.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:22.559+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:22.761 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:22.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:23.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:23.551+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:23.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:23.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:24.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:24.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:24.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:24.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:25.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:25.547+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:25.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:25.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:26.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:26.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:26.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:26.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:27.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:27.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:27.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:27.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:28.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:28.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:28.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:28.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:29.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:29.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:29.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:29.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:30.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:30.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:30.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:30.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:31.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:31.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:31.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:31.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:32.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:32.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:32.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:32.715+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:33.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:33.539+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:33.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:33.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:34.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:34.567+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:34.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:34.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:35.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:35.591+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:35.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:35.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:36.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:36.591+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:36.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:36.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:37.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:37.587+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:37.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:37.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:38.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:38.539+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:38.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:38.815+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:39.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:39.559+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:39.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:39.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:40.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:40.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:40.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:40.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:41.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:41.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:41.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:41.863+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:42.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:42.567+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:42.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:42.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:43.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:43.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:43.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:43.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:44.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:44.519+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:44.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:44.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:45.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:45.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:45.921 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:45.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:46.500 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:46.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:46.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:46.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:47.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:47.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:47.955 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:47.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:48.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:48.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:48.965 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:48.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:49.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:49.467+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:50.006 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:49.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:50.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:50.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:50.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:50.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:51.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:51.447+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:52.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:52.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:52.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:52.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:52.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:52.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:53.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:53.447+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:54.022 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:54.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:54.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:54.471+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:54.991 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:54.983+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:55.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:55.451+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:55.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:55.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:56.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:56.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:56.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:56.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:57.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:57.463+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:57.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:57.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:58.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:58.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:58.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:58.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:59.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:15:59.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:15:59.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:15:59.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:00.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:00.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:00.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:00.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:01.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:01.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:01.975 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:01.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:02.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:02.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:02.978 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:02.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:03.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:03.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:03.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:03.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:04.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:04.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:04.948 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:04.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:05.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:05.455+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:05.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:05.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:06.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:06.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:06.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:06.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:07.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:07.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:07.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:07.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:08.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:08.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:08.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:08.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:09.492 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:09.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:09.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:09.822+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:10.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:10.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:10.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:10.834+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:11.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:11.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:11.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:11.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:12.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:12.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:12.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:12.834+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:13.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:13.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:13.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:13.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:14.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:14.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:14.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:14.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:15.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:15.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:15.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:15.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:16.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:16.470+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:16.828 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:16.822+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:17.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:17.470+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:17.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:17.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:18.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:18.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:18.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:18.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:19.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:19.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:19.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:19.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:20.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:20.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:20.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:20.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:21.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:21.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:21.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:21.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:22.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:22.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:22.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:22.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:23.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:23.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:23.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:23.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:24.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:24.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:24.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:24.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:25.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:25.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:25.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:25.714+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:26.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:26.374+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:26.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:26.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:27.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:27.386+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:27.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:27.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:28.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:28.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:28.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:28.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:29.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:29.378+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:29.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:29.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:30.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:30.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:30.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:30.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:31.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:31.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:31.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:31.666+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:32.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:32.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:32.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:32.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:33.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:33.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:33.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:33.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:34.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:34.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:34.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:34.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:35.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:35.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:35.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:35.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:36.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:36.394+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:36.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:36.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:37.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:37.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:37.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:37.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:38.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:38.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:38.595 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:38.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:39.411 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:39.402+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:39.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:39.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:40.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:40.370+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:40.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:40.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:41.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:41.394+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:41.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:41.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:42.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:42.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:42.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:42.474+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:43.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:43.394+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:43.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:43.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:44.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:44.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:44.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:44.466+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:45.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:45.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:45.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:45.478+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:46.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:46.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:46.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:46.518+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:47.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:47.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:47.525 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:47.518+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:48.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:48.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:48.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:48.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:49.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:49.418+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:49.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:49.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:50.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:50.378+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:50.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:50.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:51.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:51.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:51.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:51.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:52.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:52.318+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:52.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:52.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:53.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:53.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:53.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:53.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:54.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:54.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:54.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:54.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:55.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:55.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:55.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:55.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:56.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:56.281+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:56.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:56.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:57.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:57.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:57.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:57.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:58.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:58.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:58.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:58.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:59.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:16:59.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:16:59.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:16:59.709+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:00.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:00.213+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:00.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:00.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:01.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:01.229+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:01.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:01.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:02.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:02.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:02.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:02.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:03.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:03.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:03.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:03.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:04.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:04.233+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:04.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:04.805+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:05.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:05.273+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:05.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:05.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:06.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:06.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:06.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:06.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:07.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:07.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:07.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:07.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:08.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:08.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:08.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:08.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:09.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:09.281+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:09.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:09.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:10.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:10.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:10.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:10.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:11.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:11.305+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:11.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:11.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:12.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:12.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:12.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:12.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:13.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:13.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:13.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:13.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:14.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:14.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:14.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:14.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:15.354 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:15.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:15.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:15.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:16.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:16.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:16.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:16.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:17.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:17.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:17.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:17.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:18.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:18.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:18.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:18.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:19.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:19.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:19.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:19.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:20.348 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:20.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:20.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:20.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:21.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:21.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:21.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:21.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:22.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:22.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:22.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:22.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:23.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:23.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:23.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:23.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:24.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:24.333+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:24.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:24.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:25.303 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:25.301+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:25.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:25.649+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:26.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:26.257+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:26.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:26.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:27.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:27.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:27.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:27.653+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:28.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:28.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:28.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:28.665+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:29.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:29.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:29.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:29.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:30.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:30.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:30.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:30.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:31.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:31.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:31.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:31.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:32.321 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:32.317+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:32.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:32.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:33.300 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:33.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:33.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:33.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:34.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:34.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:34.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:34.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:35.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:35.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:35.870 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:35.865+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:36.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:36.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:36.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:36.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:37.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:37.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:37.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:37.869+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:38.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:38.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:38.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:38.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:39.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:39.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:39.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:39.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:40.231 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:40.224+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:40.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:40.940+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:41.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:41.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:41.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:41.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:42.260 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:42.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:42.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:42.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:43.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:43.248+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:43.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:43.888+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:44.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:44.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:44.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:44.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:45.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:45.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:45.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:45.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:46.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:46.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:46.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:46.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:47.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:47.160+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:47.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:47.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:48.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:48.164+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:48.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:48.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:49.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:49.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:49.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:49.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:50.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:50.164+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:50.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:50.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:51.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:51.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:51.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:51.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:52.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:52.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:52.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:52.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:53.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:53.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:53.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:53.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:54.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:54.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:54.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:54.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:55.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:55.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:55.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:55.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:56.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:56.312+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:56.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:56.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:57.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:57.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:57.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:57.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:58.286 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:58.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:58.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:58.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:59.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:17:59.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:17:59.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:17:59.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:00.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:00.284+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:00.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:00.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:01.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:01.320+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:01.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:01.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:02.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:02.332+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:02.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:02.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:03.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:03.380+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:03.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:03.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:04.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:04.380+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:04.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:04.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:05.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:05.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:05.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:05.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:06.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:06.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:06.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:06.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:07.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:07.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:07.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:07.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:08.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:08.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:08.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:08.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:09.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:09.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:09.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:09.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:10.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:10.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:10.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:10.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:11.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:11.496+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:11.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:11.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:12.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:12.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:12.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:12.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:13.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:13.472+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:13.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:13.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:14.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:14.496+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:14.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:14.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:15.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:15.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:15.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:15.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:16.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:16.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:16.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:16.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:17.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:17.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:17.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:17.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:18.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:18.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:18.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:18.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:19.604 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:19.600+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:19.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:19.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:20.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:20.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:20.809 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:20.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:21.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:21.508+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:21.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:21.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:22.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:22.464+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:22.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:22.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:23.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:23.508+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:23.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:23.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:24.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:24.492+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:24.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:24.808+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:25.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:25.480+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:25.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:25.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:26.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:26.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:26.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:26.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:27.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:27.563+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:27.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:27.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:28.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:28.595+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:28.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:28.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:29.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:29.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:29.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:29.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:30.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:30.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:30.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:30.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:31.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:31.587+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:31.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:31.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:32.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:32.627+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:32.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:32.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:33.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:33.639+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:33.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:33.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:34.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:34.671+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:34.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:34.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:35.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:35.707+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:35.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:35.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:36.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:36.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:36.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:36.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:37.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:37.751+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:37.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:37.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:38.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:38.723+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:38.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:38.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:39.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:39.751+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:39.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:39.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:40.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:40.719+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:40.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:40.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:41.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:41.751+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:41.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:41.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:42.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:42.723+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:42.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:42.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:43.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:43.719+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:43.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:43.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:44.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:44.687+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:44.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:44.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:45.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:45.719+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:45.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:45.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:46.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:46.683+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:46.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:46.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:47.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:47.679+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:47.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:47.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:48.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:48.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:48.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:48.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:49.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:49.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:49.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:49.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:50.688 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:50.683+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:50.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:50.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:51.700 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:51.695+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:51.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:51.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:52.670 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:52.663+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:52.809 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:52.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:53.679 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:53.671+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:53.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:53.839+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:54.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:54.667+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:54.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:54.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:55.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:55.683+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:55.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:55.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:56.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:56.647+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:56.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:56.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:57.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:57.619+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:57.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:57.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:58.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:58.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:58.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:58.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:59.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:18:59.623+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:18:59.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:18:59.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:00.676 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:00.671+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:00.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:00.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:01.677 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:01.671+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:01.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:01.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:02.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:02.635+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:02.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:02.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:03.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:03.611+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:03.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:03.911+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:04.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:04.631+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:04.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:04.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:05.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:05.667+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:05.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:05.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:06.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:06.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:06.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:06.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:07.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:07.655+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:07.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:07.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:08.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:08.691+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:08.822 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:08.815+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:09.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:09.731+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:09.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:09.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:10.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:10.775+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:10.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:10.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:11.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:11.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:11.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:11.823+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:12.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:12.774+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:12.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:12.830+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:13.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:13.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:13.886 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:13.878+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:14.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:14.726+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:14.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:14.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:15.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:15.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:15.830 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:15.822+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:16.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:16.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:16.835 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:16.826+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:17.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:17.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:17.853 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:17.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:18.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:18.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:18.854 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:18.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:19.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:19.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:19.811 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:19.806+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:20.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:20.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:20.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:20.770+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:21.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:21.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:21.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:21.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:22.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:22.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:22.809 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:22.802+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:23.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:23.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:23.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:23.822+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:24.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:24.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:24.803 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:24.798+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:25.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:25.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:25.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:25.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:26.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:26.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:26.812 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:26.806+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:27.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:27.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:27.785 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:27.778+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:28.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:28.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:28.780 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:28.774+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:29.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:29.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:29.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:29.810+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:30.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:30.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:30.848 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:30.842+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:31.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:31.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:31.807 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:31.802+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:32.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:32.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:32.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:32.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:33.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:33.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:33.786 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:33.778+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:34.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:34.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:34.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:34.802+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:35.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:35.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:35.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:35.818+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:36.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:36.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:36.817 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:36.810+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:37.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:37.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:37.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:37.766+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:38.645 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:38.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:38.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:38.742+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:39.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:39.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:39.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:39.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:40.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:40.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:40.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:40.726+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:41.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:41.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:41.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:41.742+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:42.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:42.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:42.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:42.722+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:43.595 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:43.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:43.733 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:43.726+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:44.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:44.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:44.774 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:44.766+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:45.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:45.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:45.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:45.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:46.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:46.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:46.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:46.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:47.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:47.534+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:47.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:47.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:48.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:48.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:48.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:48.818+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:49.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:49.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:49.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:49.782+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:50.572 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:50.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:50.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:50.762+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:51.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:51.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:51.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:51.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:52.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:52.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:52.821 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:52.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:53.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:53.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:53.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:53.774+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:54.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:54.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:54.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:54.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:55.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:55.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:55.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:55.742+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:56.546 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:56.538+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:56.801 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:56.794+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:57.597 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:57.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:57.771 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:57.762+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:58.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:58.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:58.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:58.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:59.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:19:59.589+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:19:59.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:19:59.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:00.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:00.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:00.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:00.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:01.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:01.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:01.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:01.733+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:02.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:02.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:02.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:02.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:03.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:03.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:03.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:03.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:04.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:04.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:04.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:04.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:05.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:05.605+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:05.760 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:05.757+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:06.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:06.657+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:06.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:06.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:07.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:07.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:07.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:07.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:08.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:08.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:08.730 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:08.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:09.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:09.657+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:09.751 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:09.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:10.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:10.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:10.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:10.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:11.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:11.649+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:11.757 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:11.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:12.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:12.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:12.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:12.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:13.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:13.581+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:13.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:13.761+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:14.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:14.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:14.726 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:14.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:15.550 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:15.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:15.702 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:15.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:16.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:16.501+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:16.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:16.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:17.515 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:17.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:17.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:17.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:18.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:18.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:18.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:18.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:19.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:19.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:19.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:19.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:20.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:20.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:20.756 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:20.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:21.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:21.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:21.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:21.797+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:22.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:22.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:22.783 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:22.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:23.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:23.489+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:23.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:23.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:24.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:24.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:24.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:24.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:25.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:25.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:25.844 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:25.841+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:26.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:26.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:26.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:26.833+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:27.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:27.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:27.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:27.861+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:28.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:28.497+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:28.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:28.889+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:29.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:29.473+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:29.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:29.873+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:30.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:30.497+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:30.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:30.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:31.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:31.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:31.951 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:31.949+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:32.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:32.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:32.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:32.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:33.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:33.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:33.970 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:33.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:34.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:34.489+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:35.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:35.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:35.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:35.461+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:36.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:36.057+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:36.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:36.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:37.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:37.105+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:37.470 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:37.465+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:38.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:38.149+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:38.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:38.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:39.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:39.145+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:39.452 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:39.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:40.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:40.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:40.422 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:40.417+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:41.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:41.157+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:41.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:41.461+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:42.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:42.113+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:42.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:42.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:43.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:43.085+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:43.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:43.397+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:44.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:44.077+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:44.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:44.369+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:45.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:45.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:45.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:45.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:46.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:46.068+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:46.300 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:46.296+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:47.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:47.064+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:47.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:47.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:48.084 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:48.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:48.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:48.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:49.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:49.032+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:49.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:49.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:50.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:50.072+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:50.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:50.292+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:51.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:51.068+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:51.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:51.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:52.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:52.116+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:52.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:52.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:53.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:53.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:53.327 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:53.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:54.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:54.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:54.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:54.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:55.185 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:55.180+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:55.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:55.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:56.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:56.128+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:56.267 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:56.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:57.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:57.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:57.274 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:57.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:58.137 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:58.132+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:58.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:58.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:59.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:20:59.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:20:59.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:20:59.296+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:00.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:00.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:00.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:00.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:01.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:01.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:01.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:01.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:02.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:02.120+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:02.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:02.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:03.131 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:03.128+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:03.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:03.276+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:04.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:04.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:04.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:04.316+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:05.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:05.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:05.337 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:05.332+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:06.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:06.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:06.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:06.372+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:07.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:07.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:07.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:07.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:08.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:08.168+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:08.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:08.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:09.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:09.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:09.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:09.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:10.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:10.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:10.297 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:10.292+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:11.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:11.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:11.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:11.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:12.267 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:12.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:12.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:12.392+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:13.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:13.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:13.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:13.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:14.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:14.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:14.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:14.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:15.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:15.300+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:15.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:15.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:16.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:16.304+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:16.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:16.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:17.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:17.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:17.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:17.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:18.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:18.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:18.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:18.512+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:19.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:19.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:19.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:19.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:20.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:20.300+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:20.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:20.464+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:21.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:21.296+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:21.463 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:21.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:22.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:22.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:22.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:22.412+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:23.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:23.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:23.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:23.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:24.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:24.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:24.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:24.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:25.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:25.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:25.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:25.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:26.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:26.264+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:26.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:26.440+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:27.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:27.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:27.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:27.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:28.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:28.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:28.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:28.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:29.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:29.316+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:29.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:29.516+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:30.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:30.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:30.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:30.492+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:31.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:31.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:31.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:31.531+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:32.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:32.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:32.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:32.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:33.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:33.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:33.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:33.555+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:34.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:34.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:34.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:34.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:35.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:35.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:35.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:35.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:36.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:36.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:36.587 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:36.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:37.267 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:37.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:37.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:37.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:38.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:38.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:38.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:38.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:39.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:39.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:39.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:39.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:40.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:40.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:40.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:40.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:41.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:41.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:41.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:41.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:42.203 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:42.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:42.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:42.695+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:43.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:43.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:43.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:43.683+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:44.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:44.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:44.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:44.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:45.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:45.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:45.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:45.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:46.172 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:46.167+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:46.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:46.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:47.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:47.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:47.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:47.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:48.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:48.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:48.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:48.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:49.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:49.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:49.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:49.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:50.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:50.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:50.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:50.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:51.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:51.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:51.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:51.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:52.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:52.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:52.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:52.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:53.219 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:53.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:53.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:53.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:54.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:54.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:54.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:54.579+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:55.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:55.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:55.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:55.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:56.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:56.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:56.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:56.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:57.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:57.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:57.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:57.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:58.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:58.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:58.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:58.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:59.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:21:59.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:21:59.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:21:59.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:00.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:00.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:00.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:00.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:01.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:01.167+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:01.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:01.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:02.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:02.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:02.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:02.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:03.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:03.131+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:03.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:03.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:04.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:04.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:04.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:04.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:05.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:05.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:05.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:05.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:06.096 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:06.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:06.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:06.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:07.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:07.047+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:07.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:07.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:08.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:08.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:08.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:08.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:08.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:08.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:09.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:09.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:09.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:09.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:10.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:10.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:10.941 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:10.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:11.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:11.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:11.913 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:11.907+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:12.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:12.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:12.902 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:12.895+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:13.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:13.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:13.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:13.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:14.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:14.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:14.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:14.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:15.774 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:15.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:15.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:15.927+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:16.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:16.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:16.888 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:16.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:17.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:17.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:17.871 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:17.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:18.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:18.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:18.851 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:18.846+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:19.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:19.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:19.895 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:19.886+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:20.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:20.854+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:20.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:20.866+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:21.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:21.814+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:21.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:21.858+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:22.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:22.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:22.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:22.834+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:23.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:23.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:23.892 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:23.886+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:24.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:24.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:24.890 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:24.882+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:25.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:25.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:25.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:25.926+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:26.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:26.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:26.942 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:26.934+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:27.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:27.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:27.990 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:27.982+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:28.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:28.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:29.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:29.006+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:29.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:29.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:29.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:29.990+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:30.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:30.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:30.987 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:30.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:31.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:31.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:32.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:31.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:32.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:32.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:32.981 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:32.974+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:33.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:33.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:34.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:34.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:34.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:34.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:34.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:34.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:35.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:35.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:35.985 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:35.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:36.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:36.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:36.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:36.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:37.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:37.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:37.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:37.982+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:38.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:38.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:39.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:39.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:39.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:39.666+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:40.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:40.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:40.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:40.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:41.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:41.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:41.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:41.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:42.031 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:42.022+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:42.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:42.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:42.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:42.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:43.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:43.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:44.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:44.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:44.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:44.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:45.066 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:45.058+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:45.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:45.614+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:46.078 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:46.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:46.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:46.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:47.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:47.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:47.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:47.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:48.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:48.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:48.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:48.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:49.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:49.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:49.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:49.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:49.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:49.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:50.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:50.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:51.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:51.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:51.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:51.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:52.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:52.042+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:52.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:52.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:53.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:53.026+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:53.595 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:53.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:54.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:53.998+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:54.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:54.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:54.971 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:54.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:55.525 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:55.518+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:56.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:56.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:56.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:56.494+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:56.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:56.978+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:57.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:57.514+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:57.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:57.962+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:58.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:58.494+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:59.008 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:59.002+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:59.470 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:22:59.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:22:59.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:22:59.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:00.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:00.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:00.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:00.954+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:01.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:01.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:01.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:01.970+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:02.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:02.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:03.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:03.018+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:03.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:03.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:04.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:04.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:04.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:04.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:04.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:04.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:05.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:05.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:06.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:06.017+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:06.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:06.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:07.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:07.001+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:07.611 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:07.601+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:08.052 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:08.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:08.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:08.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:09.067 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:09.061+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:09.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:09.585+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:10.024 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:10.017+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:10.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:10.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:11.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:11.049+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:11.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:11.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:12.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:12.049+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:12.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:12.617+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:13.081 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:13.077+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:13.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:13.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:14.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:14.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:14.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:14.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:15.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:15.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:15.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:15.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:15.983 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:15.981+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:16.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:16.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:16.998 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:16.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:17.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:17.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:18.018 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:18.013+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:18.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:18.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:19.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:19.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:19.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:19.589+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:20.029 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:20.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:20.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:20.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:20.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:20.989+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:21.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:21.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:21.984 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:21.981+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:22.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:22.641+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:22.961 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:22.957+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:23.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:23.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:23.957 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:23.953+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:24.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:24.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:24.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:24.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:25.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:25.689+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:25.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:25.989+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:26.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:26.653+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:27.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:27.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:27.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:27.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:28.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:28.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:28.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:28.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:29.001 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:28.997+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:29.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:29.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:29.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:29.985+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:30.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:30.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:31.030 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:31.025+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:31.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:31.709+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:32.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:32.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:32.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:32.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:33.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:33.009+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:33.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:33.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:34.025 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:34.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:34.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:34.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:35.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:35.033+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:35.783 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:35.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:36.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:36.017+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:36.761 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:36.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:36.975 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:36.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:37.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:37.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:37.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:37.945+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:38.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:38.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:38.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:38.973+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:39.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:39.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:39.982 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:39.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:40.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:40.689+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:41.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:41.021+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:41.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:41.681+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:42.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:42.029+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:42.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:42.681+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:42.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:42.993+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:43.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:43.681+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:44.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:44.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:44.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:44.665+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:45.006 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:45.001+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:45.632 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:45.629+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:45.987 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:45.981+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:46.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:46.657+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:46.980 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:46.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:47.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:47.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:47.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:47.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:48.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:48.641+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:48.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:48.937+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:49.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:49.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:49.904 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:49.900+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:50.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:50.612+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:50.912 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:50.908+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:51.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:51.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:51.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:51.920+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:52.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:52.640+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:52.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:52.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:53.669 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:53.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:53.928 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:53.920+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:54.649 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:54.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:54.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:54.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:55.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:55.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:55.986 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:55.980+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:56.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:56.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:56.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:56.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:57.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:57.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:57.958 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:57.952+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:58.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:58.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:58.995 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:23:58.992+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:23:59.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:23:59.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:00.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:00.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:00.755 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:00.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:01.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:01.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:01.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:01.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:02.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:02.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:02.781 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:02.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:02.988 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:02.984+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:03.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:03.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:04.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:04.012+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:04.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:04.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:05.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:05.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:05.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:05.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:06.022 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:06.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:06.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:06.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:06.978 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:06.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:07.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:07.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:08.004 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:08.000+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:08.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:08.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:09.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:09.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:09.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:09.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:09.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:09.968+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:10.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:10.696+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:10.962 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:10.956+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:11.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:11.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:11.992 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:11.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:12.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:12.648+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:13.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:13.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:13.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:13.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:14.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:14.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:14.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:14.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:15.017 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:15.012+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:15.655 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:15.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:16.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:16.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:16.657 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:16.652+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:17.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:17.068+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:17.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:17.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:18.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:18.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:18.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:18.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:19.036 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:19.032+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:19.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:19.592+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:20.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:20.028+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:20.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:20.636+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:21.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:21.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:21.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:21.664+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:22.099 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:22.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:22.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:22.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:23.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:23.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:23.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:23.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:24.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:24.052+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:24.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:24.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:25.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:25.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:25.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:25.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:26.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:26.068+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:26.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:26.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:27.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:27.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:27.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:27.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:28.103 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:28.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:28.754 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:28.748+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:29.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:29.140+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:29.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:29.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:30.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:30.164+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:30.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:30.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:31.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:31.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:31.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:31.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:32.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:32.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:32.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:32.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:33.153 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:33.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:33.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:33.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:34.138 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:34.132+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:34.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:34.768+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:35.142 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:35.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:35.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:35.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:36.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:36.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:36.789 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:36.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:37.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:37.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:37.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:37.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:38.148 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:38.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:38.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:38.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:39.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:39.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:39.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:39.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:40.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:40.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:40.670 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:40.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:41.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:41.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:41.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:41.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:42.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:42.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:42.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:42.683+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:43.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:43.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:43.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:43.691+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:44.160 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:44.155+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:44.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:44.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:45.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:45.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:45.727 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:45.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:46.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:46.071+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:46.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:46.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:47.041 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:47.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:47.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:47.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:48.039 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:48.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:48.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:48.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:49.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:49.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:49.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:49.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:50.033 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:50.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:50.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:50.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:51.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:51.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:51.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:51.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:52.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:52.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:52.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:52.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:53.089 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:53.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:53.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:53.811+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:54.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:54.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:54.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:54.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:55.118 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:55.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:55.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:55.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:56.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:56.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:56.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:56.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:57.132 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:57.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:57.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:57.819+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:58.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:58.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:58.859 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:58.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:59.119 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:24:59.111+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:24:59.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:24:59.863+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:00.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:00.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:00.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:00.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:01.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:01.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:01.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:01.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:02.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:02.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:02.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:02.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:03.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:03.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:03.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:03.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:04.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:04.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:04.863 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:04.859+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:05.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:05.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:05.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:05.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:06.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:06.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:06.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:06.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:07.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:07.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:07.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:07.863+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:08.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:08.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:08.919 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:08.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:09.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:09.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:09.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:09.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:10.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:10.207+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:11.011 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:11.007+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:11.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:11.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:12.036 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:12.031+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:12.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:12.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:13.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:13.031+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:13.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:13.167+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:13.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:13.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:14.153 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:14.147+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:14.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:14.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:15.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:15.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:15.933 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:15.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:16.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:16.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:16.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:16.907+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:17.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:17.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:17.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:17.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:18.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:18.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:18.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:18.883+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:19.164 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:19.159+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:19.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:19.851+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:20.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:20.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:20.908 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:20.903+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:21.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:21.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:21.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:21.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:22.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:22.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:22.915 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:22.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:23.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:23.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:23.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:23.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:24.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:24.190+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:24.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:24.922+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:25.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:25.190+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:25.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:25.914+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:26.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:26.190+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:26.962 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:26.954+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:27.187 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:27.182+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:27.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:27.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:28.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:28.214+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:28.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:28.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:29.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:29.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:29.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:29.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:30.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:30.186+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:30.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:30.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:31.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:31.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:31.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:31.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:32.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:32.270+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:32.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:32.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:33.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:33.286+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:33.906 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:33.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:34.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:34.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:34.868 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:34.862+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:35.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:35.342+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:35.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:35.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:36.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:36.298+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:36.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:36.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:37.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:37.306+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:37.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:37.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:38.329 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:38.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:38.872 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:38.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:39.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:39.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:39.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:39.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:40.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:40.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:40.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:40.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:41.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:41.302+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:41.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:41.902+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:42.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:42.338+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:42.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:42.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:43.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:43.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:43.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:43.962+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:44.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:44.402+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:45.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:45.010+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:45.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:45.390+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:45.983 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:45.974+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:46.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:46.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:46.988 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:46.982+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:47.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:47.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:47.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:47.962+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:48.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:48.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:48.927 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:48.922+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:49.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:49.470+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:49.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:49.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:50.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:50.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:50.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:50.898+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:51.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:51.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:51.954 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:51.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:52.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:52.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:52.923 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:52.914+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:53.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:53.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:53.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:53.946+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:54.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:54.514+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:54.932 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:54.926+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:55.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:55.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:55.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:55.962+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:56.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:56.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:56.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:56.966+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:57.589 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:57.582+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:57.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:57.990+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:58.640 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:58.634+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:59.016 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:59.010+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:59.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:25:59.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:25:59.986 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:25:59.978+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:00.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:00.690+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:00.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:00.934+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:01.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:01.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:01.917 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:01.910+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:02.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:02.714+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:02.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:02.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:03.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:03.718+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:03.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:03.870+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:04.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:04.770+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:04.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:04.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:05.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:05.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:05.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:05.890+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:06.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:06.726+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:06.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:06.930+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:07.779 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:07.774+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:07.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:07.893+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:08.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:08.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:08.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:08.865+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:09.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:09.789+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:09.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:09.913+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:10.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:10.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:10.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:10.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:11.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:11.809+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:11.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:11.889+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:12.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:12.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:12.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:12.857+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:13.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:13.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:13.903 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:13.897+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:14.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:14.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:14.940 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:14.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:15.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:15.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:15.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:15.953+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:16.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:16.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:16.945 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:16.941+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:17.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:17.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:17.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:17.929+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:18.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:18.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:18.974 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:18.969+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:19.925 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:19.921+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:19.947 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:19.945+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:20.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:20.885+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:20.982 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:20.977+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:21.929 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:21.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:21.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:21.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:22.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:22.917+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:22.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:22.965+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:23.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:23.933+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:23.971 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:23.965+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:24.948 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:24.945+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:24.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:24.949+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:25.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:25.945+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:25.981 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:25.977+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:26.917 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:26.913+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:26.957 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:26.953+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:27.919 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:27.917+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:28.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:27.997+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:28.921 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:28.917+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:29.031 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:29.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:29.957 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:29.953+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:30.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:30.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:31.007 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:31.005+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:31.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:31.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:32.050 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:32.045+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:32.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:32.089+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:33.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:33.057+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:33.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:33.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:34.095 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:34.089+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:34.095 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:34.093+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:35.076 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:35.073+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:35.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:35.093+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:36.069 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:36.065+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:36.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:36.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:37.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:37.097+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:37.148 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:37.145+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:38.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:38.097+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:38.143 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:38.137+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:39.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:39.133+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:39.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:39.133+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:40.156 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:40.153+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:40.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:40.165+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:41.185 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:41.181+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:41.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:41.197+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:42.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:42.189+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:42.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:42.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:43.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:43.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:43.251 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:43.245+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:44.198 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:44.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:44.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:44.261+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:45.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:45.221+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:45.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:45.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:46.186 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:46.181+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:46.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:46.333+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:47.162 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:47.157+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:47.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:47.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:48.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:48.137+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:48.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:48.245+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:49.122 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:49.117+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:49.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:49.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:50.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:50.093+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:50.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:50.245+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:51.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:51.077+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:51.218 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:51.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:52.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:52.109+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:52.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:52.177+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:53.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:53.141+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:53.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:53.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:54.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:54.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:54.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:54.200+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:55.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:55.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:55.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:55.232+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:56.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:56.140+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:56.271 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:56.264+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:57.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:57.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:57.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:57.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:58.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:58.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:58.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:58.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:59.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:26:59.132+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:26:59.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:26:59.316+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:00.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:00.144+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:00.337 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:00.332+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:01.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:01.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:01.368 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:01.364+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:02.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:02.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:02.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:02.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:03.117 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:03.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:03.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:03.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:04.113 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:04.108+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:04.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:04.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:05.122 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:05.116+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:05.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:05.500+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:06.172 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:06.168+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:06.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:06.532+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:07.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:07.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:07.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:07.512+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:08.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:08.160+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:08.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:08.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:09.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:09.196+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:09.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:09.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:10.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:10.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:10.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:10.520+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:11.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:11.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:11.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:11.504+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:12.167 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:12.164+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:12.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:12.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:13.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:13.120+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:13.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:13.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:14.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:14.120+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:14.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:14.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:15.106 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:15.100+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:15.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:15.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:16.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:16.132+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:16.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:16.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:17.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:17.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:17.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:17.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:18.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:18.164+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:18.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:18.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:19.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:19.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:19.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:19.412+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:20.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:20.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:20.430 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:20.424+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:21.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:21.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:21.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:21.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:22.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:22.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:22.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:22.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:23.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:23.196+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:23.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:23.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:24.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:24.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:24.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:24.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:25.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:25.184+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:25.463 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:25.460+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:26.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:26.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:26.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:26.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:27.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:27.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:27.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:27.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:28.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:28.160+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:28.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:28.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:29.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:29.152+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:29.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:29.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:30.153 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:30.148+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:30.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:30.384+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:31.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:31.164+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:31.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:31.376+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:32.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:32.200+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:32.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:32.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:33.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:33.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:33.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:33.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:34.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:34.244+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:34.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:34.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:35.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:35.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:35.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:35.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:36.323 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:36.316+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:36.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:36.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:37.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:37.300+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:37.490 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:37.484+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:38.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:38.264+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:38.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:38.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:39.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:39.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:39.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:39.504+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:40.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:40.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:40.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:40.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:41.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:41.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:41.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:41.519+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:42.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:42.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:42.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:42.535+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:43.328 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:43.323+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:43.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:43.535+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:44.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:44.327+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:44.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:44.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:45.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:45.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:45.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:45.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:46.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:46.339+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:46.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:46.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:47.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:47.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:47.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:47.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:48.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:48.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:48.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:48.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:49.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:49.339+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:49.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:49.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:50.335 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:50.327+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:50.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:50.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:51.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:51.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:51.599 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:51.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:52.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:52.355+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:52.556 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:52.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:53.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:53.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:53.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:53.539+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:54.370 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:54.363+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:54.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:54.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:55.349 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:55.343+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:55.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:55.543+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:56.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:56.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:56.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:56.579+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:57.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:57.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:57.578 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:57.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:58.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:58.255+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:58.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:58.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:59.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:27:59.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:27:59.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:27:59.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:00.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:00.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:00.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:00.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:01.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:01.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:01.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:01.599+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:02.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:02.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:02.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:02.595+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:03.210 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:03.203+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:03.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:03.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:04.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:04.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:04.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:04.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:05.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:05.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:05.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:05.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:06.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:06.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:06.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:06.563+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:07.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:07.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:07.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:07.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:08.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:08.327+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:08.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:08.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:09.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:09.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:09.668 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:09.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:10.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:10.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:10.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:10.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:11.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:11.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:11.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:11.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:12.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:12.307+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:12.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:12.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:13.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:13.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:13.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:13.695+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:14.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:14.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:14.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:14.731+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:15.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:15.339+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:15.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:15.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:16.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:16.351+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:16.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:16.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:17.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:17.375+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:17.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:17.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:18.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:18.359+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:18.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:18.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:19.362 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:19.355+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:19.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:19.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:20.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:20.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:20.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:20.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:21.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:21.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:21.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:21.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:22.419 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:22.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:22.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:22.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:23.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:23.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:23.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:23.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:24.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:24.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:24.848 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:24.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:25.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:25.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:25.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:25.827+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:26.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:26.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:26.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:26.798+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:27.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:27.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:27.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:27.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:28.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:28.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:28.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:28.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:29.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:29.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:29.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:29.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:30.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:30.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:30.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:30.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:31.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:31.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:31.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:31.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:32.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:32.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:32.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:32.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:33.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:33.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:33.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:33.810+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:34.602 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:34.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:34.860 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:34.854+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:35.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:35.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:35.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:35.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:36.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:36.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:36.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:36.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:37.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:37.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:37.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:37.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:38.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:38.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:38.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:38.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:39.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:39.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:39.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:39.762+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:40.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:40.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:40.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:40.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:41.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:41.582+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:41.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:41.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:42.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:42.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:42.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:42.758+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:43.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:43.522+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:43.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:43.714+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:44.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:44.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:44.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:44.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:45.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:45.514+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:45.732 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:45.726+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:46.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:46.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:46.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:46.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:47.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:47.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:47.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:47.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:48.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:48.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:48.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:48.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:49.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:49.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:49.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:49.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:50.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:50.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:50.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:50.726+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:51.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:51.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:51.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:51.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:52.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:52.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:52.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:52.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:53.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:53.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:53.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:53.718+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:54.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:54.722+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:54.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:54.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:55.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:55.742+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:55.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:55.758+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:56.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:56.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:56.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:56.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:57.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:57.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:57.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:57.762+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:58.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:58.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:58.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:58.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:59.707 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:28:59.702+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:28:59.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:28:59.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:00.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:00.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:00.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:00.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:01.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:01.702+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:01.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:01.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:02.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:02.706+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:02.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:02.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:03.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:03.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:03.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:03.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:04.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:04.674+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:04.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:04.714+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:05.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:05.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:05.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:05.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:06.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:06.706+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:06.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:06.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:07.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:07.670+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:07.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:07.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:08.659 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:08.654+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:08.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:08.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:09.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:09.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:09.846 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:09.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:10.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:10.658+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:10.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:10.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:11.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:11.694+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:11.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:11.810+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:12.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:12.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:12.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:12.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:13.681 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:13.673+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:13.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:13.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:14.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:14.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:14.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:14.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:15.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:15.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:15.812 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:15.805+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:16.775 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:16.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:16.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:16.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:17.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:17.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:17.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:17.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:18.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:18.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:18.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:18.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:19.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:19.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:19.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:19.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:20.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:20.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:20.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:20.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:21.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:21.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:21.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:21.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:22.710 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:22.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:22.816 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:22.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:23.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:23.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:23.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:23.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:24.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:24.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:24.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:24.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:25.713 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:25.709+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:25.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:25.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:26.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:26.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:26.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:26.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:27.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:27.673+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:27.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:27.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:28.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:28.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:28.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:28.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:29.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:29.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:29.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:29.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:30.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:30.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:30.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:30.829+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:31.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:31.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:31.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:31.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:32.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:32.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:32.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:32.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:33.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:33.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:33.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:33.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:34.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:34.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:34.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:34.805+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:35.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:35.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:35.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:35.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:36.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:36.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:36.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:36.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:37.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:37.573+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:37.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:37.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:38.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:38.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:38.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:38.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:39.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:39.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:39.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:39.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:40.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:40.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:40.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:40.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:41.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:41.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:41.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:41.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:42.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:42.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:42.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:42.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:43.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:43.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:43.871 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:43.869+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:44.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:44.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:44.899 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:44.893+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:45.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:45.481+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:45.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:45.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:46.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:46.489+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:46.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:46.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:47.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:47.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:47.942 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:47.937+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:48.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:48.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:48.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:48.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:49.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:49.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:49.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:49.929+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:50.437 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:50.433+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:50.945 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:50.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:51.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:51.425+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:51.952 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:51.949+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:52.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:52.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:52.959 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:52.957+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:53.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:53.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:53.956 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:53.953+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:54.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:54.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:54.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:54.993+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:55.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:55.333+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:56.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:56.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:56.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:56.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:57.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:57.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:57.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:57.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:58.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:58.052+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:58.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:58.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:59.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:29:59.016+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:29:59.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:29:59.300+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:00.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:00.028+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:00.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:00.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:01.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:01.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:01.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:01.300+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:02.036 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:02.032+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:02.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:02.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:03.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:03.032+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:03.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:03.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:04.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:04.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:04.261 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:04.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:05.108 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:05.104+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:05.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:05.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:06.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:06.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:06.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:06.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:07.102 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:07.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:07.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:07.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:08.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:08.060+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:08.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:08.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:09.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:09.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:09.312 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:09.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:10.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:10.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:10.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:10.352+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:11.015 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:11.012+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:11.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:11.316+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:11.972 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:11.968+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:12.372 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:12.368+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:12.939 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:12.936+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:13.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:13.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:13.982 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:13.976+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:14.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:14.440+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:14.978 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:14.972+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:15.415 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:15.412+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:15.961 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:15.956+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:16.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:16.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:16.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:16.944+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:17.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:17.440+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:17.970 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:17.964+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:18.434 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:18.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:19.022 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:19.016+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:19.392 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:19.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:20.043 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:20.036+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:20.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:20.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:21.037 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:21.032+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:21.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:21.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:22.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:22.048+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:22.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:22.448+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:23.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:23.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:23.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:23.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:24.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:24.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:24.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:24.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:25.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:25.064+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:25.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:25.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:26.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:26.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:26.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:26.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:27.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:27.084+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:27.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:27.372+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:28.102 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:28.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:28.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:28.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:29.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:29.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:29.373 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:29.368+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:30.112 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:30.108+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:30.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:30.364+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:31.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:31.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:31.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:31.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:32.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:32.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:32.399 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:32.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:33.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:33.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:33.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:33.372+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:34.043 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:34.040+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:34.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:34.376+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:35.049 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:35.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:35.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:35.348+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:36.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:36.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:36.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:36.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:37.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:37.032+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:37.361 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:37.356+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:38.070 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:38.064+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:38.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:38.360+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:39.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:39.064+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:39.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:39.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:40.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:40.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:40.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:40.344+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:41.024 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:41.020+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:41.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:41.360+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:42.003 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:42.000+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:42.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:42.328+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:43.007 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:43.000+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:43.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:43.324+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:44.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:44.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:44.377 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:44.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:44.997 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:44.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:45.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:45.359+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:46.001 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:45.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:46.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:46.351+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:47.044 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:47.039+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:47.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:47.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:48.008 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:48.003+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:48.387 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:48.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:48.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:48.967+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:49.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:49.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:49.926 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:49.919+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:50.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:50.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:50.958 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:50.951+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:51.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:51.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:51.935 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:51.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:52.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:52.467+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:52.945 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:52.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:53.464 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:53.459+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:53.963 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:53.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:54.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:54.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:54.998 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:54.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:55.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:55.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:55.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:55.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:56.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:56.519+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:56.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:56.955+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:57.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:57.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:57.966 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:57.959+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:58.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:58.587+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:58.983 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:30:58.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:30:59.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:30:59.555+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:00.033 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:00.027+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:00.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:00.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:01.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:00.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:01.486 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:01.479+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:02.007 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:01.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:02.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:02.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:03.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:03.043+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:03.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:03.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:04.061 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:04.055+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:04.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:04.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:05.081 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:05.075+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:05.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:05.543+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:06.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:06.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:06.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:06.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:07.123 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:07.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:07.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:07.471+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:08.117 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:08.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:08.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:08.431+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:09.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:09.067+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:09.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:09.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:10.068 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:10.063+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:10.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:10.415+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:11.039 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:11.031+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:11.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:11.439+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:12.007 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:11.999+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:12.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:12.475+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:13.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:13.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:13.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:13.507+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:14.091 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:14.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:14.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:14.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:15.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:15.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:15.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:15.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:16.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:16.151+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:16.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:16.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:17.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:17.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:17.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:17.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:18.138 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:18.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:18.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:18.555+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:19.107 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:19.103+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:19.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:19.519+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:20.123 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:20.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:20.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:20.555+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:21.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:21.079+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:21.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:21.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:22.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:22.107+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:22.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:22.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:23.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:23.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:23.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:23.539+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:24.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:24.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:24.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:24.575+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:25.179 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:25.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:25.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:25.579+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:26.152 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:26.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:26.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:26.599+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:27.163 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:27.159+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:27.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:27.591+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:28.172 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:28.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:28.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:28.543+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:29.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:29.183+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:29.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:29.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:30.154 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:30.146+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:30.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:30.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:31.132 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:31.126+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:31.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:31.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:32.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:32.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:32.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:32.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:33.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:33.122+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:33.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:33.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:34.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:34.094+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:34.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:34.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:35.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:35.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:35.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:35.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:36.036 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:36.030+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:36.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:36.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:37.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:37.046+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:37.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:37.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:38.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:38.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:38.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:38.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:39.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:39.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:39.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:39.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:40.062 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:40.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:40.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:40.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:41.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:41.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:41.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:41.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:42.074 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:42.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:42.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:42.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:43.073 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:43.066+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:43.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:43.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:44.064 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:44.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:44.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:44.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:45.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:45.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:45.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:45.598+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:46.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:46.062+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:46.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:46.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:47.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:47.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:47.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:47.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:48.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:48.098+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:48.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:48.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:49.113 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:49.106+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:49.602 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:49.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:50.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:50.130+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:50.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:50.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:51.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:51.106+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:51.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:51.538+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:52.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:52.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:52.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:52.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:53.052 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:53.046+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:53.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:53.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:54.075 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:54.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:54.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:54.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:55.035 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:55.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:55.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:55.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:56.035 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:56.030+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:56.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:56.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:57.078 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:57.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:57.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:57.522+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:58.090 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:58.082+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:58.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:58.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:59.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:31:59.038+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:31:59.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:31:59.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:00.010 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:00.002+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:00.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:00.458+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:01.024 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:01.018+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:01.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:01.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:02.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:02.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:02.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:02.538+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:03.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:03.050+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:03.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:03.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:04.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:04.062+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:04.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:04.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:05.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:05.058+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:05.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:05.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:06.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:06.070+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:06.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:06.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:07.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:07.034+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:07.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:07.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:08.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:08.010+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:08.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:08.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:09.005 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:08.998+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:09.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:09.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:09.980 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:09.974+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:10.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:10.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:11.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:10.994+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:11.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:11.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:12.015 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:12.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:12.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:12.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:13.060 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:13.054+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:13.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:13.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:14.015 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:14.006+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:14.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:14.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:15.032 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:15.026+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:15.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:15.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:15.998 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:15.989+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:16.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:16.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:16.960 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:16.953+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:17.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:17.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:17.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:17.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:18.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:18.657+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:18.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:18.901+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:19.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:19.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:19.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:19.917+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:20.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:20.661+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:20.918 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:20.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:21.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:21.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:21.904 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:21.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:22.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:22.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:22.909 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:22.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:23.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:23.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:23.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:23.937+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:24.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:24.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:24.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:24.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:25.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:25.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:25.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:25.933+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:26.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:26.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:26.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:26.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:27.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:27.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:27.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:27.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:28.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:28.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:28.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:28.889+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:29.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:29.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:29.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:29.941+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:30.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:30.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:30.931 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:30.929+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:31.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:31.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:31.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:31.889+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:32.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:32.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:32.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:32.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:33.657 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:33.653+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:33.865 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:33.861+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:34.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:34.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:34.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:34.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:35.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:35.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:35.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:35.945+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:36.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:36.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:36.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:36.917+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:37.659 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:37.657+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:37.910 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:37.905+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:38.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:38.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:38.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:38.893+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:39.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:39.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:39.916 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:39.913+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:40.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:40.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:40.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:40.949+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:41.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:41.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:41.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:41.973+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:42.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:42.697+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:43.006 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:43.001+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:43.680 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:43.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:44.036 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:44.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:44.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:44.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:45.027 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:45.025+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:45.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:45.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:45.996 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:45.993+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:46.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:46.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:47.036 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:47.033+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:47.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:47.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:48.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:48.077+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:48.688 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:48.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:49.083 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:49.081+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:49.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:49.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:50.110 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:50.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:50.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:50.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:51.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:51.085+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:51.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:51.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:52.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:52.073+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:52.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:52.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:53.097 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:53.093+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:53.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:53.537+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:54.111 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:54.105+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:54.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:54.493+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:55.069 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:55.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:55.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:55.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:56.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:56.113+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:56.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:56.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:57.114 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:57.109+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:57.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:57.537+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:58.071 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:58.065+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:58.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:58.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:59.056 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:32:59.053+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:32:59.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:32:59.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:00.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:00.045+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:00.589 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:00.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:01.021 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:01.017+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:01.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:01.628+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:02.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:02.052+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:02.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:02.588+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:03.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:03.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:03.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:03.596+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:04.055 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:04.052+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:04.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:04.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:05.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:05.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:05.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:05.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:06.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:06.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:06.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:06.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:07.066 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:07.060+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:07.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:07.516+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:08.034 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:08.028+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:08.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:08.516+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:09.006 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:09.000+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:09.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:09.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:09.967 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:09.960+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:10.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:10.532+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:10.993 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:10.988+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:11.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:11.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:12.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:12.012+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:12.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:12.544+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:13.012 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:13.008+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:13.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:13.576+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:14.010 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:14.004+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:14.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:14.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:15.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:15.036+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:15.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:15.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:16.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:16.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:16.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:16.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:17.015 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:17.012+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:17.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:17.588+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:18.058 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:18.052+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:18.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:18.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:19.099 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:19.092+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:19.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:19.516+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:20.079 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:20.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:20.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:20.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:21.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:21.044+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:21.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:21.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:22.057 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:22.052+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:22.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:22.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:23.072 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:23.068+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:23.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:23.464+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:24.045 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:24.040+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:24.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:24.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:25.061 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:25.056+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:25.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:25.440+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:26.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:26.056+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:26.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:26.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:27.076 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:27.072+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:27.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:27.464+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:28.080 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:28.076+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:28.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:28.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:29.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:29.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:29.436 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:29.432+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:30.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:30.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:30.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:30.392+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:31.093 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:31.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:31.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:31.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:32.053 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:32.048+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:32.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:32.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:33.091 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:33.088+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:33.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:33.496+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:34.089 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:34.084+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:34.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:34.488+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:35.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:35.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:35.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:35.532+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:36.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:36.172+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:36.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:36.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:37.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:37.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:37.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:37.524+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:38.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:38.212+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:38.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:38.504+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:39.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:39.264+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:39.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:39.524+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:40.241 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:40.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:40.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:40.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:41.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:41.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:41.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:41.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:42.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:42.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:42.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:42.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:43.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:43.288+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:43.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:43.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:44.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:44.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:44.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:44.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:45.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:45.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:45.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:45.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:46.230 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:46.224+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:46.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:46.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:47.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:47.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:47.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:47.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:48.229 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:48.223+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:48.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:48.579+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:49.236 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:49.231+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:49.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:49.591+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:50.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:50.251+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:50.607 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:50.603+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:51.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:51.303+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:51.650 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:51.643+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:52.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:52.315+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:52.627 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:52.619+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:53.338 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:53.331+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:53.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:53.587+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:54.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:54.311+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:54.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:54.619+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:55.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:55.315+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:55.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:55.583+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:56.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:56.283+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:56.606 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:56.599+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:57.313 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:57.307+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:57.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:57.635+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:58.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:58.319+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:58.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:58.619+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:59.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:33:59.315+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:33:59.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:33:59.595+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:00.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:00.319+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:00.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:00.623+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:01.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:01.319+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:01.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:01.667+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:02.369 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:02.363+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:02.670 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:02.663+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:03.332 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:03.327+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:03.636 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:03.631+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:04.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:04.339+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:04.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:04.595+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:05.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:05.311+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:05.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:05.563+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:06.341 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:06.335+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:06.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:06.607+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:07.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:07.311+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:07.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:07.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:08.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:08.355+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:08.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:08.667+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:09.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:09.391+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:09.640 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:09.635+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:10.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:10.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:10.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:10.635+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:11.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:11.359+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:11.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:11.615+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:12.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:12.363+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:12.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:12.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:13.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:13.387+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:13.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:13.707+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:14.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:14.359+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:14.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:14.679+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:15.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:15.347+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:15.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:15.675+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:16.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:16.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:16.680 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:16.675+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:17.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:17.439+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:17.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:17.627+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:18.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:18.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:18.602 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:18.595+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:19.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:19.399+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:19.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:19.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:20.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:20.363+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:20.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:20.539+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:21.381 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:21.375+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:21.547 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:21.543+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:22.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:22.403+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:22.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:22.507+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:23.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:23.355+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:23.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:23.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:24.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:24.391+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:24.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:24.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:25.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:25.435+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:25.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:25.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:26.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:26.423+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:26.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:26.551+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:27.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:27.443+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:27.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:27.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:28.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:28.479+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:28.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:28.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:29.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:29.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:29.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:29.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:30.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:30.495+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:30.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:30.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:31.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:31.471+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:31.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:31.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:32.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:32.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:32.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:32.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:33.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:33.455+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:33.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:33.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:34.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:34.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:34.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:34.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:35.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:35.534+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:35.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:35.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:36.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:36.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:36.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:36.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:37.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:37.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:37.606 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:37.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:38.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:38.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:38.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:38.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:39.536 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:39.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:39.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:39.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:40.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:40.494+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:40.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:40.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:41.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:41.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:41.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:41.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:42.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:42.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:42.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:42.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:43.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:43.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:43.583 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:43.578+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:44.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:44.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:44.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:44.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:45.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:45.522+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:45.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:45.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:46.497 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:46.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:46.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:46.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:47.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:47.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:47.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:47.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:48.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:48.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:48.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:48.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:49.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:49.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:49.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:49.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:50.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:50.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:50.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:50.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:51.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:51.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:51.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:51.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:52.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:52.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:52.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:52.490+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:53.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:53.478+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:53.537 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:53.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:54.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:54.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:54.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:54.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:55.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:55.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:55.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:55.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:56.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:56.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:56.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:56.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:57.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:57.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:57.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:57.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:58.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:58.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:58.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:58.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:59.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:34:59.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:34:59.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:34:59.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:00.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:00.426+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:00.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:00.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:01.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:01.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:01.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:01.530+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:02.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:02.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:02.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:02.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:03.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:03.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:03.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:03.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:04.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:04.482+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:04.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:04.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:05.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:05.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:05.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:05.522+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:06.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:06.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:06.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:06.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:07.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:07.494+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:07.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:07.554+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:08.472 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:08.466+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:08.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:08.602+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:09.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:09.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:09.572 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:09.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:10.468 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:10.462+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:10.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:10.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:11.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:11.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:11.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:11.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:12.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:12.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:12.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:12.554+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:13.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:13.474+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:13.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:13.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:14.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:14.446+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:14.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:14.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:15.410 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:15.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:15.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:15.618+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:16.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:16.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:16.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:16.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:17.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:17.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:17.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:17.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:18.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:18.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:18.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:18.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:19.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:19.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:19.621 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:19.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:20.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:20.446+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:20.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:20.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:21.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:21.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:21.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:21.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:22.495 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:22.489+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:22.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:22.565+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:23.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:23.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:23.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:23.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:24.489 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:24.481+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:24.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:24.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:25.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:25.473+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:25.619 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:25.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:26.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:26.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:26.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:26.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:27.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:27.465+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:27.659 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:27.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:28.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:28.445+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:28.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:28.605+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:29.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:29.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:29.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:29.565+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:30.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:30.405+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:30.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:30.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:31.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:31.417+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:31.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:31.545+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:32.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:32.421+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:32.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:32.565+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:33.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:33.441+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:33.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:33.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:34.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:34.417+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:34.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:34.521+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:35.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:35.389+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:35.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:35.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:36.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:36.377+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:36.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:36.481+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:37.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:37.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:37.513 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:37.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:38.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:38.337+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:38.561 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:38.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:39.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:39.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:39.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:39.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:40.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:40.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:40.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:40.521+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:41.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:41.297+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:41.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:41.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:42.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:42.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:42.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:42.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:43.308 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:43.305+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:43.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:43.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:44.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:44.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:44.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:44.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:45.305 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:45.301+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:45.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:45.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:46.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:46.281+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:46.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:46.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:47.259 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:47.257+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:47.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:47.581+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:48.294 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:48.289+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:48.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:48.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:49.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:49.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:49.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:49.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:50.320 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:50.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:50.689 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:50.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:51.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:51.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:51.687 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:51.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:52.321 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:52.317+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:52.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:52.701+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:53.297 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:53.293+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:53.747 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:53.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:54.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:54.269+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:54.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:54.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:55.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:55.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:55.812 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:55.809+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:56.252 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:56.249+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:56.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:56.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:57.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:57.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:57.856 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:57.853+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:58.264 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:58.261+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:58.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:58.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:59.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:35:59.229+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:35:59.857 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:35:59.853+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:00.258 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:00.253+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:00.834 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:00.829+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:01.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:01.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:01.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:01.841+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:02.219 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:02.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:02.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:02.849+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:03.216 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:03.213+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:03.826 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:03.821+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:04.246 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:04.241+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:04.786 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:04.781+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:05.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:05.265+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:05.808 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:05.805+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:06.233 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:06.229+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:06.833 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:06.829+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:07.186 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:07.181+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:07.835 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:07.833+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:08.231 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:08.225+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:08.819 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:08.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:09.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:09.257+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:09.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:09.857+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:10.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:10.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:10.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:10.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:11.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:11.304+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:11.838 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:11.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:12.342 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:12.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:12.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:12.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:13.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:13.332+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:13.827 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:13.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:14.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:14.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:14.783 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:14.780+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:15.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:15.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:15.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:15.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:16.315 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:16.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:16.792 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:16.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:17.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:17.288+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:17.836 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:17.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:18.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:18.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:18.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:18.828+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:19.312 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:19.308+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:19.876 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:19.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:20.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:20.316+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:20.828 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:20.824+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:21.276 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:21.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:21.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:21.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:22.283 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:22.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:22.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:22.848+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:23.304 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:23.300+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:23.841 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:23.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:24.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:24.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:24.831 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:24.828+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:25.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:25.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:25.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:25.816+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:26.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:26.440+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:26.869 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:26.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:27.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:27.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:27.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:27.868+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:28.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:28.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:28.877 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:28.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:29.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:29.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:29.843 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:29.840+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:30.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:30.484+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:30.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:30.816+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:31.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:31.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:31.821 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:31.816+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:32.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:32.492+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:32.865 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:32.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:33.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:33.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:33.893 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:33.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:34.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:34.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:34.901 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:34.896+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:35.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:35.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:35.914 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:35.908+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:36.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:36.376+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:36.898 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:36.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:37.353 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:37.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:37.861 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:37.856+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:38.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:38.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:38.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:38.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:39.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:39.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:39.873 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:39.868+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:40.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:40.352+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:40.838 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:40.832+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:41.335 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:41.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:41.857 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:41.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:42.333 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:42.328+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:42.881 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:42.876+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:43.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:43.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:43.856 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:43.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:44.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:44.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:44.821 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:44.816+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:45.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:45.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:45.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:45.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:46.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:46.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:46.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:46.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:47.383 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:47.380+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:47.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:47.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:48.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:48.368+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:48.830 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:48.824+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:49.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:49.384+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:49.860 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:49.856+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:50.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:50.360+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:50.895 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:50.892+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:51.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:51.404+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:51.934 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:51.928+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:52.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:52.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:52.938 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:52.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:53.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:53.372+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:53.953 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:53.948+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:54.418 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:54.412+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:54.964 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:54.960+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:55.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:55.376+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:55.994 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:55.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:56.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:56.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:57.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:57.036+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:57.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:57.392+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:58.012 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:58.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:58.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:58.423+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:58.989 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:36:58.983+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:36:59.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:36:59.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:00.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:00.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:00.524 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:00.519+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:01.026 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:01.019+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:01.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:01.531+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:02.071 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:02.063+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:02.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:02.559+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:03.091 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:03.083+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:03.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:03.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:04.125 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:04.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:04.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:04.483+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:05.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:05.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:05.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:05.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:06.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:06.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:06.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:06.435+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:07.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:07.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:07.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:07.479+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:08.130 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:08.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:08.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:08.495+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:09.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:09.099+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:09.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:09.515+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:10.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:10.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:10.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:10.547+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:11.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:11.155+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:11.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:11.575+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:12.189 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:12.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:12.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:12.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:13.156 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:13.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:13.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:13.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:14.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:14.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:14.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:14.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:15.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:15.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:15.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:15.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:16.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:16.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:16.643 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:16.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:17.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:17.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:17.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:17.683+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:18.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:18.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:18.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:18.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:19.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:19.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:19.635 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:19.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:20.148 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:20.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:20.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:20.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:21.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:21.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:21.687 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:21.679+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:22.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:22.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:22.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:22.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:23.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:23.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:23.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:23.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:24.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:24.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:24.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:24.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:25.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:25.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:25.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:25.683+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:26.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:26.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:26.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:26.691+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:27.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:27.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:27.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:27.679+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:28.176 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:28.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:28.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:28.675+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:29.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:29.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:29.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:29.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:30.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:30.207+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:30.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:30.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:31.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:31.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:31.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:31.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:32.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:32.215+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:32.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:32.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:33.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:33.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:33.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:33.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:34.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:34.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:34.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:34.695+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:35.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:35.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:35.699 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:35.695+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:36.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:36.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:36.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:36.655+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:37.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:37.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:37.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:37.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:38.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:38.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:38.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:38.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:39.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:39.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:39.626 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:39.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:40.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:40.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:40.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:40.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:41.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:41.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:41.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:41.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:42.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:42.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:42.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:42.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:43.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:43.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:43.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:43.715+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:44.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:44.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:44.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:44.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:45.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:45.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:45.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:45.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:46.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:46.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:46.727 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:46.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:47.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:47.330+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:47.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:47.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:48.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:48.366+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:48.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:48.782+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:49.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:49.390+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:49.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:49.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:50.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:50.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:50.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:50.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:51.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:51.394+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:51.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:51.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:52.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:52.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:52.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:52.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:53.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:53.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:53.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:53.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:54.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:54.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:54.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:54.762+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:55.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:55.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:55.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:55.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:56.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:56.286+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:56.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:56.714+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:57.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:57.314+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:57.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:57.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:58.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:58.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:58.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:58.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:59.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:37:59.322+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:37:59.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:37:59.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:00.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:00.370+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:00.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:00.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:01.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:01.418+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:01.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:01.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:02.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:02.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:02.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:02.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:03.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:03.402+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:03.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:03.754+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:04.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:04.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:04.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:04.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:05.430 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:05.422+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:05.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:05.774+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:06.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:06.378+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:06.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:06.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:07.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:07.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:07.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:07.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:08.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:08.386+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:08.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:08.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:09.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:09.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:09.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:09.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:10.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:10.386+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:10.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:10.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:11.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:11.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:11.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:11.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:12.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:12.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:12.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:12.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:13.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:13.374+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:13.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:13.694+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:14.393 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:14.386+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:14.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:14.726+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:15.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:15.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:15.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:15.762+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:16.417 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:16.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:16.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:16.714+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:17.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:17.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:17.689 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:17.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:18.476 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:18.470+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:18.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:18.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:19.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:19.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:19.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:19.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:20.482 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:20.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:20.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:20.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:21.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:21.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:21.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:21.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:22.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:22.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:22.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:22.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:23.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:23.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:23.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:23.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:24.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:24.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:24.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:24.766+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:25.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:25.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:25.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:25.818+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:26.483 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:26.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:26.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:26.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:27.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:27.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:27.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:27.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:28.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:28.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:28.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:28.782+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:29.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:29.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:29.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:29.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:30.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:30.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:30.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:30.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:31.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:31.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:31.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:31.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:32.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:32.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:32.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:32.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:33.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:33.425+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:33.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:33.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:34.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:34.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:34.761 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:34.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:35.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:35.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:35.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:35.797+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:36.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:36.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:36.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:36.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:37.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:37.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:37.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:37.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:38.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:38.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:38.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:38.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:39.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:39.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:39.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:39.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:40.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:40.409+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:40.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:40.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:41.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:41.441+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:41.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:41.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:42.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:42.485+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:42.878 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:42.873+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:43.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:43.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:43.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:43.881+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:44.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:44.545+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:44.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:44.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:45.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:45.497+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:45.906 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:45.901+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:46.485 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:46.481+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:46.950 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:46.945+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:47.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:47.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:47.905 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:47.901+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:48.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:48.413+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:48.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:48.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:49.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:49.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:49.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:49.897+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:50.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:50.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:50.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:50.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:51.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:51.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:51.953 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:51.949+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:52.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:52.405+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:52.928 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:52.925+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:53.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:53.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:53.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:53.889+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:54.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:54.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:54.914 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:54.909+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:55.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:55.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:55.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:55.877+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:56.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:56.305+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:56.866 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:56.861+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:57.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:57.277+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:57.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:57.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:58.284 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:58.281+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:58.824 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:58.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:59.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:38:59.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:38:59.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:38:59.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:00.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:00.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:00.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:00.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:01.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:01.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:01.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:01.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:02.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:02.257+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:02.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:02.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:03.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:03.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:03.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:03.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:04.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:04.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:04.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:04.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:05.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:05.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:05.722 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:05.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:06.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:06.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:06.747 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:06.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:07.330 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:07.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:07.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:07.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:08.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:08.365+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:08.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:08.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:09.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:09.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:09.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:09.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:10.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:10.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:10.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:10.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:11.319 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:11.317+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:11.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:11.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:12.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:12.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:12.796 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:12.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:13.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:13.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:13.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:13.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:14.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:14.313+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:14.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:14.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:15.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:15.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:15.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:15.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:16.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:16.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:16.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:16.693+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:17.379 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:17.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:17.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:17.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:18.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:18.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:18.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:18.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:19.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:19.444+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:19.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:19.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:20.475 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:20.472+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:20.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:20.716+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:21.427 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:21.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:21.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:21.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:22.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:22.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:22.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:22.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:23.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:23.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:23.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:23.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:24.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:24.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:24.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:24.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:25.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:25.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:25.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:25.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:26.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:26.516+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:26.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:26.632+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:27.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:27.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:27.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:27.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:28.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:28.520+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:28.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:28.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:29.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:29.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:29.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:29.608+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:30.547 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:30.544+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:30.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:30.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:31.566 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:31.560+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:31.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:31.616+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:32.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:32.520+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:32.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:32.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:33.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:33.524+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:33.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:33.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:34.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:34.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:34.605 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:34.600+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:35.535 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:35.532+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:35.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:35.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:36.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:36.528+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:36.601 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:36.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:37.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:37.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:37.571 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:37.568+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:38.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:38.544+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:38.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:38.608+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:39.531 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:39.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:39.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:39.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:40.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:40.532+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:40.563 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:40.560+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:41.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:41.520+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:41.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:41.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:42.525 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:42.520+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:42.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:42.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:43.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:43.500+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:43.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:43.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:44.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:44.516+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:44.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:44.620+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:45.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:45.560+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:45.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:45.608+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:46.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:46.580+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:46.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:46.592+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:47.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:47.552+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:47.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:47.592+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:48.544 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:48.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:48.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:48.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:49.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:49.548+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:49.582 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:49.576+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:50.584 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:50.580+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:50.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:50.596+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:51.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:51.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:51.645 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:51.640+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:52.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:52.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:52.693 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:52.688+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:53.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:53.484+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:53.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:53.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:54.507 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:54.504+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:54.659 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:54.656+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:55.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:55.464+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:55.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:55.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:56.504 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:56.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:56.685 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:56.680+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:57.466 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:57.460+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:57.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:57.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:58.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:58.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:58.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:58.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:59.491 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:39:59.488+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:39:59.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:39:59.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:00.458 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:00.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:00.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:00.780+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:01.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:01.496+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:01.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:01.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:02.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:02.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:02.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:02.800+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:03.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:03.472+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:03.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:03.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:04.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:04.520+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:04.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:04.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:05.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:05.492+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:05.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:05.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:06.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:06.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:06.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:06.835+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:07.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:07.507+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:07.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:07.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:08.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:08.511+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:08.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:08.847+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:09.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:09.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:09.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:09.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:10.478 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:10.471+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:10.890 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:10.883+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:11.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:11.487+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:11.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:11.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:12.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:12.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:12.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:12.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:13.510 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:13.503+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:13.907 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:13.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:14.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:14.491+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:14.895 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:14.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:15.523 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:15.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:15.891 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:15.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:16.514 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:16.507+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:16.893 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:16.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:17.542 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:17.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:17.937 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:17.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:18.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:18.551+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:18.936 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:18.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:19.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:19.539+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:19.934 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:19.927+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:20.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:20.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:20.903 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:20.899+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:21.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:21.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:21.897 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:21.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:22.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:22.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:22.949 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:22.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:23.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:23.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:23.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:23.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:24.461 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:24.455+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:24.981 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:24.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:25.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:25.423+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:25.943 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:25.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:26.474 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:26.467+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:26.944 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:26.939+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:27.467 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:27.463+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:27.994 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:27.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:28.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:28.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:28.998 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:28.991+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:29.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:29.471+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:29.979 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:29.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:30.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:30.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:30.976 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:30.971+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:31.412 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:31.407+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:31.987 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:31.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:32.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:32.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:32.983 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:32.979+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:33.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:33.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:33.969 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:33.963+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:34.384 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:34.379+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:34.981 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:34.975+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:35.342 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:35.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:36.018 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:36.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:36.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:36.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:37.048 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:37.043+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:37.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:37.347+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:38.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:38.095+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:38.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:38.351+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:39.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:39.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:39.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:39.367+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:40.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:40.123+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:40.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:40.371+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:41.133 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:41.127+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:41.337 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:41.331+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:42.151 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:42.147+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:42.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:42.375+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:43.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:43.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:43.381 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:43.375+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:44.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:44.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:44.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:44.403+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:45.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:45.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:45.407 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:45.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:46.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:46.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:46.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:46.427+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:47.104 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:47.099+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:47.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:47.399+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:48.147 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:48.143+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:48.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:48.383+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:49.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:49.111+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:49.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:49.431+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:50.141 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:50.135+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:50.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:50.439+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:51.100 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:51.095+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:51.443 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:51.439+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:52.116 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:52.110+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:52.453 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:52.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:53.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:53.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:53.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:53.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:54.142 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:54.134+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:54.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:54.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:55.183 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:55.178+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:55.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:55.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:56.157 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:56.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:56.484 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:56.478+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:57.180 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:57.174+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:57.502 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:57.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:58.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:58.142+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:58.496 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:58.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:59.158 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:40:59.150+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:40:59.462 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:40:59.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:00.150 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:00.142+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:00.488 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:00.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:01.145 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:01.138+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:01.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:01.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:02.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:02.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:02.560 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:02.554+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:03.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:03.126+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:03.588 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:03.582+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:04.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:04.118+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:04.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:04.634+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:05.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:05.166+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:05.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:05.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:06.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:06.198+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:06.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:06.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:07.211 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:07.206+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:07.673 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:07.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:08.175 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:08.170+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:08.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:08.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:09.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:09.214+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:09.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:09.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:10.270 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:10.262+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:10.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:10.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:11.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:11.266+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:11.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:11.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:12.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:12.266+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:12.704 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:12.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:13.225 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:13.218+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:13.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:13.706+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:14.261 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:14.254+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:14.694 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:14.686+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:15.243 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:15.238+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:15.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:15.662+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:16.256 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:16.250+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:16.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:16.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:17.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:17.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:17.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:17.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:18.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:18.242+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:18.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:18.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:19.214 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:19.206+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:19.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:19.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:20.170 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:20.162+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:20.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:20.614+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:21.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:21.206+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:21.600 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:21.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:22.191 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:22.186+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:22.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:22.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:23.212 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:23.206+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:23.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:23.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:24.233 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:24.226+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:24.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:24.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:25.253 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:25.246+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:25.592 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:25.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:26.302 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:26.294+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:26.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:26.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:27.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:27.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:27.519 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:27.514+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:28.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:28.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:28.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:28.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:29.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:29.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:29.508 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:29.502+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:30.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:30.386+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:30.487 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:30.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:31.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:31.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:31.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:31.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:32.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:32.446+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:32.457 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:32.450+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:33.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:33.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:33.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:33.494+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:34.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:34.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:34.489 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:34.482+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:35.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:35.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:35.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:35.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:36.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:36.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:36.548 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:36.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:37.409 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:37.402+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:37.590 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:37.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:38.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:38.442+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:38.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:38.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:39.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:39.393+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:39.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:39.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:40.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:40.425+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:40.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:40.569+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:41.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:41.397+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:41.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:41.613+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:42.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:42.405+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:42.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:42.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:43.376 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:43.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:43.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:43.585+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:44.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:44.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:44.634 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:44.625+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:45.322 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:45.317+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:45.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:45.581+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:46.313 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:46.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:46.581 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:46.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:47.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:47.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:47.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:47.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:48.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:48.317+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:48.504 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:48.501+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:49.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:49.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:49.540 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:49.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:50.371 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:50.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:50.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:50.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:51.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:51.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:51.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:51.501+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:52.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:52.397+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:52.463 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:52.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:53.369 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:53.365+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:53.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:53.461+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:54.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:54.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:54.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:54.481+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:55.360 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:55.357+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:55.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:55.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:56.346 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:56.341+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:56.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:56.445+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:57.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:57.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:57.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:57.421+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:58.169 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T10:41:58.165+0000 7f3dd9265700 0 -- 172.21.15.184:0/1030270180 >> [v2:172.21.15.184:6809/21058,v1:172.21.15.184:6811/21058] conn(0x7f3db80344b0 msgr2=0x7f3db8044bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T10:41:58.338 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:58.333+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:58.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:58.441+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:59.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:41:59.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:41:59.434 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:41:59.429+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:00.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:00.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:00.450 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:00.445+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:01.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:01.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:01.479 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:01.473+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:02.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:02.341+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:02.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:02.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:03.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:03.313+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:03.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:03.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:04.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:04.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:04.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:04.557+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:05.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:05.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:05.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:05.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:06.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:06.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:06.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:06.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:07.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:07.305+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:07.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:07.589+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:08.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:08.261+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:08.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:08.589+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:09.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:09.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:09.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:09.601+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:10.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:10.233+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:10.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:10.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:11.267 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:11.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:11.638 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:11.633+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:12.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:12.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:12.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:12.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:13.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:13.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:13.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:13.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:14.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:14.233+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:14.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:14.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:15.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:15.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:15.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:15.625+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:16.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:16.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:16.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:16.621+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:17.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:17.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:17.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:17.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:18.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:18.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:18.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:18.637+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:19.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:19.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:19.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:19.641+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:20.247 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:20.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:20.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:20.677+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:21.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:21.197+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:21.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:21.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:22.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:22.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:22.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:22.609+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:23.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:23.185+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:23.602 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:23.597+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:24.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:24.233+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:24.648 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:24.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:25.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:25.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:25.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:25.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:26.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:26.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:26.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:26.580+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:27.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:27.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:27.591 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:27.588+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:28.280 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:28.276+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:28.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:28.608+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:29.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:29.228+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:29.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:29.564+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:30.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:30.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:30.615 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:30.612+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:31.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:31.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:31.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:31.568+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:32.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:32.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:32.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:32.524+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:33.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:33.252+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:33.509 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:33.504+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:34.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:34.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:34.482 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:34.476+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:35.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:35.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:35.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:35.528+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:36.249 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:36.244+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:36.504 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:36.500+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:37.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:37.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:37.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:37.460+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:38.208 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:38.204+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:38.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:38.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:39.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:39.208+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:39.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:39.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:40.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:40.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:40.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:40.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:41.133 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:41.128+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:41.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:41.392+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:42.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:42.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:42.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:42.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:43.159 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:43.156+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:43.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:43.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:44.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:44.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:44.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:44.288+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:45.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:45.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:45.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:45.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:46.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:46.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:46.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:46.304+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:47.087 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:47.084+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:47.266 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:47.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:48.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:48.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:48.246 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:48.240+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:49.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:49.092+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:49.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:49.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:50.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:50.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:50.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:50.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:51.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:51.120+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:51.269 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:51.264+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:52.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:52.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:52.291 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:52.288+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:53.095 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:53.088+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:53.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:53.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:54.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:54.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:54.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:54.268+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:55.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:55.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:55.287 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:55.284+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:56.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:56.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:56.263 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:56.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:57.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:57.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:57.301 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:57.296+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:58.116 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:58.112+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:58.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:58.260+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:59.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:42:59.120+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:42:59.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:42:59.236+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:00.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:00.136+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:00.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:00.192+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:01.110 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:01.104+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:01.174 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:01.168+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:02.063 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:02.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:02.129 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:02.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:03.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:03.040+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:03.134 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:03.128+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:04.032 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:04.028+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:04.181 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:04.176+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:05.080 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:05.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:05.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:05.212+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:06.062 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:06.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:06.214 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:06.208+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:07.054 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:07.048+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:07.233 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:07.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:08.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:08.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:08.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:08.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:09.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:09.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:09.255 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:09.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:10.003 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:09.996+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:10.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:10.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:10.993 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:10.988+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:11.215 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:11.212+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:12.043 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:12.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:12.201 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:12.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:13.095 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:13.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:13.206 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:13.199+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:14.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:14.071+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:14.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:14.175+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:15.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:15.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:15.171 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:15.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:15.999 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:15.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:16.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:16.179+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:17.045 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:17.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:17.136 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:17.131+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:18.092 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:18.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:18.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:18.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:19.077 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:19.071+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:19.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:19.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:20.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:20.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:20.093 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:20.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:21.022 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:21.015+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:21.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:21.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:22.051 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:22.047+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:22.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:22.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:23.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:23.063+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:23.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:23.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:24.042 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:24.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:24.083 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:24.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:25.067 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:25.063+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:25.111 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:25.107+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:26.061 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:26.055+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:26.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:26.147+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:27.094 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:27.087+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:27.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:27.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:28.065 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:28.059+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:28.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:28.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:29.063 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:29.059+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:29.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:29.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:30.028 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:30.023+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:30.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:30.215+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:30.992 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:30.987+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:31.171 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:31.167+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:32.040 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:32.035+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:32.135 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:32.131+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:33.017 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:33.011+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:33.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:33.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:34.002 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:33.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:34.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:34.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:35.000 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:34.995+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:35.169 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:35.163+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:36.050 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:36.043+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:36.166 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:36.159+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:37.087 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:37.083+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:37.121 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:37.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:38.126 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:38.119+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:38.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:38.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:39.143 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:39.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:39.171 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:39.167+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:40.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:40.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:40.201 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:40.195+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:41.094 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:41.087+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:41.192 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:41.187+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:42.145 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:42.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:42.243 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:42.239+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:43.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:43.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:43.279 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:43.275+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:44.165 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:44.159+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:44.237 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:44.231+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:45.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:45.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:45.264 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:45.259+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:46.146 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:46.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:46.295 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:46.291+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:47.123 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:47.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:47.318 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:47.311+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:48.141 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:48.135+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:48.330 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:48.323+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:49.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:49.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:49.289 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:49.283+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:50.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:50.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:50.275 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:50.267+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:51.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:51.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:51.296 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:51.291+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:52.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:52.167+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:52.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:52.343+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:53.166 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:53.159+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:53.299 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:53.295+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:54.124 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:54.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:54.290 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:54.283+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:55.155 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:55.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:55.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:55.279+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:56.144 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:56.139+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:56.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:56.283+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:57.193 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:57.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:57.272 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:57.267+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:58.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:58.226+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:58.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:58.250+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:59.222 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:43:59.214+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:43:59.223 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:43:59.218+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:00.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:00.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:00.227 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:00.222+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:01.197 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:01.190+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:01.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:01.194+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:02.201 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:02.194+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:02.239 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:02.234+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:03.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:03.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:03.285 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:03.278+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:04.253 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:04.246+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:04.293 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:04.286+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:05.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:05.246+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:05.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:05.326+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:06.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:06.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:06.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:06.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:07.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:07.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:07.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:07.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:08.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:08.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:08.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:08.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:09.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:09.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:09.334 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:09.326+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:10.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:10.278+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:10.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:10.374+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:11.325 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:11.318+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:11.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:11.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:12.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:12.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:12.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:12.342+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:13.298 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:13.290+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:13.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:13.350+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:14.280 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:14.274+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:14.365 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:14.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:15.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:15.318+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:15.382 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:15.374+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:16.348 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:16.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:16.416 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:16.410+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:17.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:17.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:17.465 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:17.458+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:18.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:18.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:18.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:18.418+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:19.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:19.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:19.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:19.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:20.350 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:20.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:20.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:20.506+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:21.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:21.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:21.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:21.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:22.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:22.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:22.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:22.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:23.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:23.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:23.591 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:23.586+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:24.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:24.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:24.548 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:24.542+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:25.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:25.354+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:25.525 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:25.518+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:26.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:26.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:26.551 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:26.546+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:27.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:27.310+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:27.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:27.522+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:28.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:28.302+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:28.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:28.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:29.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:29.350+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:29.518 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:29.510+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:30.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:30.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:30.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:30.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:31.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:31.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:31.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:31.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:32.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:32.338+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:32.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:32.610+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:33.354 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:33.346+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:33.638 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:33.630+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:34.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:34.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:34.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:34.670+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:35.429 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:35.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:35.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:35.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:36.399 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:36.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:36.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:36.662+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:37.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:37.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:37.625 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:37.618+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:38.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:38.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:38.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:38.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:39.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:39.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:39.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:39.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:40.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:40.410+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:40.520 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:40.514+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:41.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:41.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:41.570 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:41.562+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:42.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:42.450+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:42.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:42.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:43.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:43.406+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:43.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:43.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:44.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:44.413+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:44.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:44.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:45.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:45.381+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:45.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:45.565+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:46.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:46.393+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:46.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:46.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:47.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:47.353+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:47.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:47.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:48.351 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:48.345+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:48.527 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:48.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:49.381 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:49.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:49.534 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:49.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:50.428 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:50.421+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:50.526 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:50.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:51.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:51.405+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:51.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:51.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:52.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:52.397+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:52.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:52.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:53.387 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:53.381+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:53.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:53.497+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:54.403 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:54.401+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:54.516 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:54.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:55.432 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:55.429+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:55.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:55.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:56.392 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:56.389+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:56.538 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:56.533+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:57.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:57.441+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:57.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:57.537+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:58.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:58.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:58.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:58.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:59.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:44:59.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:44:59.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:44:59.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:00.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:00.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:00.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:00.565+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:01.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:01.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:01.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:01.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:02.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:02.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:02.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:02.509+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:03.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:03.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:03.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:03.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:04.487 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:04.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:04.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:04.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:05.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:05.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:05.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:05.509+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:06.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:06.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:06.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:06.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:07.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:07.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:07.553 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:07.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:08.562 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:08.557+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:08.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:08.569+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:09.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:09.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:09.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:09.621+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:10.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:10.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:10.605 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:10.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:11.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:11.573+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:11.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:11.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:12.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:12.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:12.587 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:12.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:13.496 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:13.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:13.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:13.553+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:14.508 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:14.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:14.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:14.557+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:15.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:15.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:15.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:15.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:16.490 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:16.485+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:16.568 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:16.565+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:17.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:17.473+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:17.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:17.597+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:18.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:18.441+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:18.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:18.645+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:19.465 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:19.461+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:19.682 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:19.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:20.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:20.417+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:20.680 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:20.677+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:21.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:21.385+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:21.720 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:21.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:22.345 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:22.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:22.749 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:22.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:23.379 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:23.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:23.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:23.741+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:24.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:24.393+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:24.781 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:24.777+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:25.360 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:25.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:25.814 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:25.809+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:26.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:26.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:26.834 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:26.829+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:27.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:27.321+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:27.820 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:27.817+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:28.317 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:28.313+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:28.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:28.853+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:29.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:29.333+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:29.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:29.865+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:30.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:30.285+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:30.846 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:30.840+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:31.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:31.300+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:31.868 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:31.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:32.268 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:32.264+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:32.864 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:32.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:33.232 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:33.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:33.824 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:33.820+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:34.217 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:34.212+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:34.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:34.872+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:35.205 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:35.200+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:35.925 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:35.920+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:36.184 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:36.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:36.976 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:36.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:37.182 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:37.176+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:37.977 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:37.972+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:38.161 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:38.156+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:39.014 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:39.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:39.192 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:39.188+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:40.020 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:40.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:40.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:40.196+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:41.057 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:41.052+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:41.165 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:41.160+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:42.035 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:42.028+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:42.135 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:42.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:43.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:43.012+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:43.187 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:43.180+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:44.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:44.008+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:44.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:44.152+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:45.021 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:45.016+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:45.155 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:45.148+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:46.055 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:46.052+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:46.130 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:46.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:47.075 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:47.072+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:47.147 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:47.144+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:48.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:48.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:48.101 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:48.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:49.127 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:49.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:49.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:49.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:50.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:50.080+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:50.144 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:50.140+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:51.079 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:51.076+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:51.106 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:51.100+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:52.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:52.060+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:52.098 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:52.092+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:53.059 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:53.056+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:53.131 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:53.128+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:54.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:54.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:54.125 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:54.120+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:55.056 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:55.052+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:55.103 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:55.096+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:56.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:56.032+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:56.137 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:56.132+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:57.051 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:57.044+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:57.128 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:57.124+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:58.100 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:58.096+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:58.168 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:58.164+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:59.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:45:59.124+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:45:59.160 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:45:59.156+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:00.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:00.168+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:00.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:00.184+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:01.170 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:01.164+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:01.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:01.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:02.204 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:02.200+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:02.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:02.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:03.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:03.188+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:03.247 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:03.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:04.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:04.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:04.222 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:04.220+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:05.229 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:05.224+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:05.249 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:05.244+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:06.202 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:06.196+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:06.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:06.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:07.189 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:07.184+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:07.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:07.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:08.188 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:08.184+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:08.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:08.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:09.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:09.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:09.234 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:09.228+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:10.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:10.248+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:10.257 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:10.252+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:11.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:11.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:11.284 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:11.280+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:12.237 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:12.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:12.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:12.304+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:13.285 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:13.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:13.310 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:13.304+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:14.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:14.272+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:14.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:14.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:15.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:15.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:15.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:15.392+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:16.235 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:16.232+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:16.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:16.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:17.204 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:17.199+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:17.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:17.419+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:18.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:18.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:18.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:18.395+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:19.200 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:19.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:19.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:19.427+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:20.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:20.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:20.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:20.459+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:21.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:21.263+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:21.488 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:21.483+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:22.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:22.287+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:22.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:22.439+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:23.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:23.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:23.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:23.411+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:24.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:24.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:24.443 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:24.439+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:25.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:25.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:25.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:25.419+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:26.251 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:26.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:26.448 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:26.443+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:27.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:27.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:27.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:27.415+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:28.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:28.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:28.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:28.379+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:29.245 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:29.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:29.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:29.339+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:30.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:30.215+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:30.347 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:30.343+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:31.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:31.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:31.333 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:31.327+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:32.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:32.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:32.288 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:32.283+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:33.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:33.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:33.250 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:33.243+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:34.188 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:34.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:34.240 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:34.235+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:35.190 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:35.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:35.244 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:35.239+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:36.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:36.203+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:36.282 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:36.275+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:37.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:37.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:37.245 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:37.239+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:38.163 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:38.159+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:38.265 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:38.259+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:39.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:39.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:39.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:39.307+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:40.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:40.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:40.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:40.299+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:41.178 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:41.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:41.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:41.319+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:42.182 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:42.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:42.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:42.367+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:43.161 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:43.155+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:43.423 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:43.419+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:44.128 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:44.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:44.437 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:44.431+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:45.151 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:45.147+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:45.416 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:45.411+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:46.129 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:46.123+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:46.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:46.407+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:47.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:47.091+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:47.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:47.447+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:48.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:48.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:48.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:48.495+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:49.034 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:49.027+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:49.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:49.471+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:50.073 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:50.067+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:50.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:50.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:51.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:51.079+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:51.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:51.455+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:52.132 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:52.127+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:52.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:52.471+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:53.150 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:53.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:53.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:53.471+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:54.164 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:54.159+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:54.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:54.435+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:55.194 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:55.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:55.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:55.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:56.174 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:56.167+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:56.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:56.455+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:57.127 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:57.119+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:57.447 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:57.439+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:58.120 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:58.115+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:58.494 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:58.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:59.156 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:46:59.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:46:59.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:46:59.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:00.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:00.195+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:00.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:00.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:01.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:01.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:01.509 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:01.503+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:02.217 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:02.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:02.505 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:02.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:03.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:03.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:03.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:03.466+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:04.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:04.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:04.509 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:04.502+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:05.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:05.170+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:05.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:05.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:06.133 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:06.126+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:06.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:06.454+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:07.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:07.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:07.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:07.438+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:08.139 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:08.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:08.397 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:08.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:09.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:09.130+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:09.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:09.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:10.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:10.174+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:10.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:10.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:11.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:11.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:11.380 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:11.374+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:12.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:12.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:12.395 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:12.386+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:13.211 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:13.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:13.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:13.382+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:14.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:14.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:14.410 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:14.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:15.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:15.202+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:15.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:15.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:16.170 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:16.162+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:16.444 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:16.438+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:17.140 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:17.134+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:17.402 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:17.394+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:18.158 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:18.150+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:18.367 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:18.362+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:19.157 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:19.150+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:19.325 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:19.318+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:20.149 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:20.142+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:20.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:20.342+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:21.112 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:21.106+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:21.311 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:21.306+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:22.082 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:22.074+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:22.322 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:22.314+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:23.057 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:23.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:23.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:23.358+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:24.105 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:24.098+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:24.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:24.366+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:25.060 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:25.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:25.396 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:25.390+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:26.097 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:26.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:26.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:26.398+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:27.072 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:27.066+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:27.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:27.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:28.058 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:28.050+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:28.407 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:28.402+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:29.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:29.054+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:29.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:29.430+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:30.092 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:30.086+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:30.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:30.422+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:31.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:31.130+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:31.426 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:31.418+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:32.098 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:32.090+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:32.463 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:32.458+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:33.134 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:33.126+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:33.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:33.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:34.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:34.170+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:34.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:34.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:35.203 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:35.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:35.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:35.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:36.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:36.194+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:36.513 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:36.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:37.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:37.222+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:37.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:37.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:38.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:38.266+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:38.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:38.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:39.302 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:39.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:39.597 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:39.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:40.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:40.258+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:40.606 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:40.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:41.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:41.290+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:41.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:41.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:42.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:42.306+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:42.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:42.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:43.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:43.334+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:43.680 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:43.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:44.351 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:44.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:44.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:44.714+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:45.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:45.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:45.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:45.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:46.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:46.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:46.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:46.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:47.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:47.326+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:47.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:47.754+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:48.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:48.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:48.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:48.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:49.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:49.294+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:49.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:49.737+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:50.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:50.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:50.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:50.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:51.293 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:51.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:51.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:51.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:52.303 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:52.297+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:52.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:52.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:53.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:53.333+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:53.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:53.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:54.385 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:54.377+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:54.858 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:54.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:55.429 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:55.425+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:55.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:55.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:56.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:56.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:56.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:56.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:57.359 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:57.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:57.829 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:57.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:58.315 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:58.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:58.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:58.837+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:59.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:47:59.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:47:59.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:47:59.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:00.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:00.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:00.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:00.829+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:01.269 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:01.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:01.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:01.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:02.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:02.233+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:02.808 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:02.805+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:03.230 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:03.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:03.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:03.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:04.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:04.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:04.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:04.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:05.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:05.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:05.788 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:05.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:06.259 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:06.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:06.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:06.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:07.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:07.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:07.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:07.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:08.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:08.245+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:08.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:08.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:09.227 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:09.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:09.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:09.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:10.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:10.201+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:10.751 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:10.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:11.185 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:11.181+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:11.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:11.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:12.183 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:12.181+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:12.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:12.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:13.213 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:13.209+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:13.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:13.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:14.172 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:14.169+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:14.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:14.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:15.154 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:15.149+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:15.782 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:15.777+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:16.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:16.145+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:16.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:16.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:17.107 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:17.105+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:17.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:17.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:18.136 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:18.133+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:18.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:18.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:19.179 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:19.177+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:19.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:19.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:20.202 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:20.197+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:20.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:20.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:21.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:21.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:21.728 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:21.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:22.221 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:22.217+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:22.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:22.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:23.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:23.205+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:23.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:23.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:24.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:24.225+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:24.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:24.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:25.199 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:25.197+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:25.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:25.733+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:26.233 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:26.229+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:26.721 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:26.717+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:27.282 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:27.277+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:27.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:27.749+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:28.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:28.325+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:28.784 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:28.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:29.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:29.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:29.786 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:29.781+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:30.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:30.373+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:30.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:30.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:31.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:31.409+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:31.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:31.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:32.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:32.445+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:32.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:32.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:33.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:33.457+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:33.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:33.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:34.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:34.477+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:34.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:34.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:35.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:35.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:35.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:35.765+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:36.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:36.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:36.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:36.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:37.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:37.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:37.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:37.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:38.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:38.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:38.772 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:38.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:39.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:39.432+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:39.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:39.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:40.406 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:40.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:40.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:40.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:41.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:41.416+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:41.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:41.792+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:42.459 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:42.456+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:42.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:42.836+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:43.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:43.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:43.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:43.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:44.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:44.404+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:44.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:44.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:45.403 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:45.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:45.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:45.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:46.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:46.444+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:46.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:46.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:47.403 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:47.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:47.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:47.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:48.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:48.444+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:48.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:48.776+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:49.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:49.488+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:49.820 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:49.816+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:50.456 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:50.452+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:50.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:50.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:51.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:51.444+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:51.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:51.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:52.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:52.464+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:52.882 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:52.876+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:53.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:53.500+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:53.836 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:53.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:54.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:54.532+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:54.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:54.812+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:55.546 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:55.540+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:55.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:55.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:56.517 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:56.512+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:56.844 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:56.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:57.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:57.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:57.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:57.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:58.576 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:58.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:58.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:58.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:59.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:48:59.576+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:48:59.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:48:59.868+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:00.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:00.624+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:00.845 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:00.840+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:01.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:01.644+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:01.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:01.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:02.651 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:02.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:02.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:02.856+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:03.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:03.688+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:03.876 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:03.872+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:04.672 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:04.668+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:04.913 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:04.908+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:05.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:05.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:05.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:05.868+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:06.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:06.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:06.922 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:06.916+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:07.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:07.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:07.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:07.948+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:08.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:08.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:08.924 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:08.920+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:09.602 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:09.596+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:09.974 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:09.968+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:10.562 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:10.556+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:10.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:10.944+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:11.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:11.576+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:11.901 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:11.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:12.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:12.596+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:12.861 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:12.856+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:13.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:13.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:13.911 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:13.908+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:14.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:14.560+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:14.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:14.896+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:15.569 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:15.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:15.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:15.852+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:16.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:16.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:16.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:16.880+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:17.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:17.600+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:17.838 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:17.832+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:18.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:18.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:18.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:18.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:19.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:19.640+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:19.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:19.804+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:20.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:20.616+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:20.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:20.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:21.618 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:21.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:21.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:21.844+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:22.623 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:22.619+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:22.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:22.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:23.661 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:23.655+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:23.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:23.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:24.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:24.687+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:24.879 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:24.871+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:25.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:25.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:25.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:25.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:26.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:26.675+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:26.902 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:26.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:27.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:27.679+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:27.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:27.907+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:28.644 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:28.639+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:28.938 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:28.931+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:29.610 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:29.603+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:29.947 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:29.943+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:30.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:30.643+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:30.930 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:30.923+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:31.676 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:31.671+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:31.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:31.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:32.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:32.703+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:32.919 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:32.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:33.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:33.731+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:33.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:33.907+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:34.695 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:34.691+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:34.920 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:34.915+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:35.665 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:35.659+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:35.951 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:35.947+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:36.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:36.623+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:36.941 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:36.935+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:37.610 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:37.603+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:37.912 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:37.907+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:38.589 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:38.583+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:38.892 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:38.887+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:39.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:39.575+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:39.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:39.895+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:40.536 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:40.531+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:40.874 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:40.867+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:41.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:41.483+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:41.898 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:41.891+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:42.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:42.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:42.885 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:42.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:43.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:43.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:43.884 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:43.879+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:44.529 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:44.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:44.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:44.855+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:45.541 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:45.535+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:45.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:45.831+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:46.505 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:46.499+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:46.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:46.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:47.556 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:47.551+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:47.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:47.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:48.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:48.559+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:48.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:48.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:49.528 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:49.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:49.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:49.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:50.577 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:50.571+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:50.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:50.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:51.586 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:51.579+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:51.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:51.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:52.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:52.551+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:52.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:52.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:53.521 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:53.515+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:53.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:53.815+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:54.499 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:54.495+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:54.804 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:54.799+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:55.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:55.475+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:55.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:55.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:56.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:56.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:56.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:56.715+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:57.531 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:57.527+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:57.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:57.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:58.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:58.543+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:58.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:58.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:59.530 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:49:59.523+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:49:59.676 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:49:59.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:00.512 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:00.507+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:00.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:00.679+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:01.470 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:01.463+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:01.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:01.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:02.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:02.443+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:02.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:02.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:03.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:03.395+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:03.701 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:03.695+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:04.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:04.351+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:04.740 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:04.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:05.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:05.303+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:05.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:05.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:06.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:06.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:06.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:06.719+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:07.295 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:07.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:07.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:07.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:08.324 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:08.319+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:08.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:08.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:09.363 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:09.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:09.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:09.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:10.345 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:10.338+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:10.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:10.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:11.364 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:11.358+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:11.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:11.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:12.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:12.402+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:12.681 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:12.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:13.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:13.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:13.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:13.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:14.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:14.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:14.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:14.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:15.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:15.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:15.737 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:15.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:16.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:16.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:16.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:16.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:17.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:17.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:17.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:17.662+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:18.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:18.498+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:18.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:18.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:19.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:19.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:19.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:19.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:20.489 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:20.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:20.707 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:20.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:21.480 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:21.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:21.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:21.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:22.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:22.434+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:22.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:22.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:23.422 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:23.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:23.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:23.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:24.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:24.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:24.764 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:24.758+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:25.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:25.490+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:25.742 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:25.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:26.540 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:26.534+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:26.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:26.698+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:27.559 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:27.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:27.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:27.682+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:28.574 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:28.566+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:28.646 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:28.638+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:29.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:29.526+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:29.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:29.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:30.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:30.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:30.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:30.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:31.582 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:31.574+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:31.679 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:31.674+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:32.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:32.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:32.632 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:32.626+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:33.630 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:33.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:33.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:33.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:34.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:34.618+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:34.637 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:34.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:35.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:35.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:35.652 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:35.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:36.667 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:36.662+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:36.691 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:36.686+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:37.661 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:37.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:37.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:37.662+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:38.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:38.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:38.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:38.638+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:39.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:39.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:39.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:39.634+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:40.593 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:40.586+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:40.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:40.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:41.561 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:41.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:41.633 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:41.626+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:42.567 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:42.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:42.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:42.666+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:43.586 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:43.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:43.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:43.622+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:44.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:44.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:44.649 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:44.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:45.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:45.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:45.642 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:45.634+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:46.597 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:46.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:46.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:46.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:47.558 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:47.550+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:47.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:47.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:48.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:48.590+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:48.684 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:48.678+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:49.565 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:49.558+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:49.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:49.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:50.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:50.594+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:50.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:50.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:51.651 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:51.646+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:51.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:51.690+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:52.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:52.694+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:52.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:52.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:53.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:53.650+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:53.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:53.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:54.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:54.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:54.840 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:54.834+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:55.578 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:55.569+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:55.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:55.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:56.533 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:56.525+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:56.823 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:56.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:57.555 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:57.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:57.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:57.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:58.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:58.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:58.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:58.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:59.554 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:50:59.545+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:50:59.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:50:59.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:00.545 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:00.537+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:00.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:00.841+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:01.549 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:01.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:01.869 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:01.865+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:02.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:02.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:02.877 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:02.873+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:03.580 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:03.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:03.849 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:03.845+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:04.123 INFO:tasks.workunit.client.0.smithi184.stderr:2024-09-17T10:51:04.117+0000 7f3dcd7fa700 -1 received signal: Terminated from timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh (PID: 26360) UID: 1000 2024-09-17T10:51:04.123 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T10:51:04.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:04.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:04.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:04.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:05.552 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:05.549+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:05.806 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:05.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:06.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:06.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:06.831 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:06.829+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:07.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:07.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:07.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:07.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:08.639 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:08.637+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:08.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:08.857+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:09.595 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:09.593+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:09.828 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:09.825+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:10.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:10.553+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:10.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:10.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:11.522 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:11.517+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:11.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:11.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:12.524 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:12.521+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:12.810 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:12.805+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:13.564 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:13.561+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:13.851 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:13.849+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:14.532 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:14.529+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:14.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:14.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:15.543 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:15.541+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:15.771 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:15.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:16.506 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:16.501+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:16.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:16.721+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:17.498 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:17.493+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:17.690 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:17.685+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:18.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:18.465+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:18.660 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:18.657+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:19.424 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:19.421+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:19.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:19.689+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:20.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:20.425+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:20.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:20.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:21.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:21.461+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:21.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:21.705+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:22.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:22.473+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:22.694 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:22.689+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:23.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:23.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:23.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:23.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:24.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:24.469+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:24.702 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:24.697+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:25.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:25.433+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:25.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:25.741+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:26.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:26.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:26.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:26.745+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:27.355 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:27.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:27.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:27.753+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:28.389 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:28.385+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:28.805 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:28.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:29.348 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:29.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:29.803 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:29.801+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:30.395 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:30.393+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:30.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:30.813+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:31.433 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:31.429+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:31.825 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:31.821+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:32.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:32.469+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:32.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:32.785+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:33.515 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:33.513+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:33.763 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:33.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:34.503 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:34.501+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:34.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:34.713+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:35.511 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:35.509+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:35.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:35.725+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:36.539 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:36.537+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:36.683 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:36.681+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:37.590 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:37.585+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:37.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:37.669+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:38.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:38.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:38.703 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:38.701+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:39.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:39.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:39.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:39.673+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:40.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:40.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:40.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:40.645+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:41.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:41.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:41.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:41.668+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:42.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:42.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:42.656 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:42.652+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:43.608 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:43.604+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:43.696 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:43.692+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:44.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:44.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:44.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:44.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:45.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:45.688+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:45.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:45.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:46.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:46.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:46.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:46.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:47.683 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:47.676+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:47.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:47.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:48.678 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:48.672+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:48.727 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:48.724+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:49.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:49.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:49.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:49.736+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:50.670 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:50.664+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:50.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:50.784+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:51.645 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:51.640+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:51.826 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:51.820+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:52.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:52.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:52.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:52.772+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:53.666 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:53.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:53.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:53.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:54.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:54.624+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:54.733 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:54.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:55.596 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:55.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:55.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:55.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:56.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:56.608+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:56.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:56.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:57.632 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:57.628+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:57.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:57.740+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:58.624 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:58.620+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:58.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:58.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:59.613 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:51:59.608+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:51:59.706 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:51:59.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:00.634 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:00.628+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:00.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:00.744+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:01.646 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:01.640+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:01.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:01.764+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:02.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:02.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:02.791 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:02.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:03.594 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:03.588+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:03.839 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:03.836+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:04.125 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-09-17T10:52:04.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:04.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:04.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:04.788+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:05.573 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:05.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:05.833 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:05.828+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:06.609 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:06.604+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:06.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:06.796+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:07.581 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:07.576+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:07.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:07.752+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:08.599 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:08.596+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:08.723 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:08.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:09.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:09.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:09.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:09.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:10.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:10.576+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:10.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:10.728+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:11.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:11.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:11.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:11.732+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:12.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:12.572+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:12.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:12.756+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:13.567 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:13.564+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:13.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:13.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:14.571 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:14.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:14.719 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:14.716+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:15.585 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:15.580+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:15.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:15.672+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:16.575 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:16.568+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:16.666 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:16.660+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:17.598 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:17.592+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:17.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:17.624+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:18.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:18.612+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:18.631 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:18.628+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:19.622 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:19.616+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:19.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:19.644+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:20.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:20.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:20.682 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:20.676+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:21.654 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:21.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:21.718 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:21.712+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:22.616 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:22.612+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:22.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:22.708+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:23.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:23.644+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:23.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:23.700+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:24.664 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:24.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:24.688 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:24.684+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:25.652 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:25.648+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:25.724 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:25.720+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:26.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:26.680+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:26.766 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:26.760+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:27.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:27.683+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:27.814 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:27.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:28.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:28.703+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:28.787 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:28.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:29.662 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:29.655+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:29.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:29.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:30.655 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:30.651+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:30.809 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:30.803+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:31.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:31.695+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:31.847 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:31.843+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:32.699 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:32.695+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:32.830 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:32.823+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:33.739 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:33.735+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:33.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:33.807+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:34.725 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:34.719+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:34.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:34.779+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:35.741 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:35.735+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:35.770 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:35.763+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:36.738 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:36.731+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:36.790 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:36.783+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:37.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:37.695+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:37.759 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:37.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:38.663 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:38.655+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:38.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:38.755+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:39.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:39.707+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:39.767 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:39.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:40.754 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:40.747+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:40.770 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:40.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:41.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:41.767+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:41.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:41.795+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:42.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:42.767+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:42.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:42.799+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:43.752 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:43.747+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:43.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:43.843+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:44.756 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:44.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:44.858 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:44.851+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:45.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:45.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:45.816 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:45.811+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:46.730 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:46.723+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:46.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:46.807+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:47.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:47.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:47.790 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:47.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:48.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:48.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:48.786 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:48.779+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:49.745 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:49.739+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:49.746 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:49.739+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:50.715 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:50.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:50.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:50.735+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:51.686 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:51.679+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:51.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:51.731+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:52.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:52.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:52.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:52.735+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:53.633 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:53.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:53.703 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:53.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:54.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:54.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:54.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:54.727+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:55.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:55.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:55.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:55.727+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:56.705 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:56.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:56.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:56.731+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:57.697 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:57.691+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:57.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:57.755+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:58.695 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:58.691+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:58.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:58.795+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:59.698 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:52:59.691+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:52:59.780 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:52:59.775+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:00.704 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:00.699+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:00.821 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:00.815+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:01.713 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:01.707+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:01.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:01.867+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:02.748 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:02.743+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:02.837 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:02.831+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:03.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:03.771+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:03.800 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:03.795+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:04.126 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-09-17T10:53:04.126 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2024-09-17T10:53:04.126 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T10:53:04.392 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi184 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2024-09-17T10:53:04.607 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9d834db987f54059aa5a0251b98c2290 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi184 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2024-09-17T10:53:04.609 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T10:53:04.620 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-09-17T10:53:04.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T10:53:04.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:04.767+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:04.797 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:04.791+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:04.918 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:53:04.918 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":166,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T08:54:08.847154+0000","last_up_change":"2024-09-17T07:49:47.682068+0000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:49:48.588254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T07:49:53.457478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"20","last_force_op_resend_prenautilus":"20","last_force_op_resend_preluminous":"20","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2024-09-17T07:50:00.751354+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"20","last_force_op_resend_prenautilus":"20","last_force_op_resend_preluminous":"20","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":21058},{"type":"v1","addr":"172.21.15.184:6811","nonce":21058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":21058},{"type":"v1","addr":"172.21.15.184:6815","nonce":21058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":21058},{"type":"v1","addr":"172.21.15.184:6823","nonce":21058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":21058},{"type":"v1","addr":"172.21.15.184:6819","nonce":21058}]},"public_addr":"172.21.15.184:6811/21058","cluster_addr":"172.21.15.184:6815/21058","heartbeat_back_addr":"172.21.15.184:6823/21058","heartbeat_front_addr":"172.21.15.184:6819/21058","state":["exists","up"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":21060},{"type":"v1","addr":"172.21.15.184:6801","nonce":21060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":21060},{"type":"v1","addr":"172.21.15.184:6803","nonce":21060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":21060},{"type":"v1","addr":"172.21.15.184:6807","nonce":21060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":21060},{"type":"v1","addr":"172.21.15.184:6805","nonce":21060}]},"public_addr":"172.21.15.184:6801/21060","cluster_addr":"172.21.15.184:6803/21060","heartbeat_back_addr":"172.21.15.184:6807/21060","heartbeat_front_addr":"172.21.15.184:6805/21060","state":["exists","up"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":21059},{"type":"v1","addr":"172.21.15.184:6810","nonce":21059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":21059},{"type":"v1","addr":"172.21.15.184:6814","nonce":21059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":21059},{"type":"v1","addr":"172.21.15.184:6822","nonce":21059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":21059},{"type":"v1","addr":"172.21.15.184:6818","nonce":21059}]},"public_addr":"172.21.15.184:6810/21059","cluster_addr":"172.21.15.184:6814/21059","heartbeat_back_addr":"172.21.15.184:6822/21059","heartbeat_front_addr":"172.21.15.184:6818/21059","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.414580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.122470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.363916+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T10:53:04.932 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T10:53:04.932 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:53:05.212 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:53:05.215 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:53:05.226 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5660,"stamp":"2024-09-17T10:53:03.557871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26757,"ondisk_log_size":26757,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292284,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823236,"statfs":{"total":289910292480,"available":288586993664,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003162"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"164'952","reported_seq":1882,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.847237+0000","last_change":"2024-09-17T07:55:46.260014+0000","last_active":"2024-09-17T08:53:28.847237+0000","last_peered":"2024-09-17T08:53:28.847237+0000","last_clean":"2024-09-17T08:53:28.847237+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T08:53:28.847237+0000","last_undegraded":"2024-09-17T08:53:28.847237+0000","last_fullsized":"2024-09-17T08:53:28.847237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:13.546583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"164'1454","reported_seq":2450,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.845731+0000","last_change":"2024-09-17T07:55:46.260362+0000","last_active":"2024-09-17T08:53:28.845731+0000","last_peered":"2024-09-17T08:53:28.845731+0000","last_clean":"2024-09-17T08:53:28.845731+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T08:53:28.845731+0000","last_undegraded":"2024-09-17T08:53:28.845731+0000","last_fullsized":"2024-09-17T08:53:28.845731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1454,"log_dups_size":0,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:58.525227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8367,"ondisk_log_size":8367,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740571,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424748,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947092,"statfs":{"total":96636764160,"available":96201822208,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.51500000000000001},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.40699999999999997},"max":{"1min":0.59099999999999997,"5min":0.68899999999999995,"15min":0.72199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.45200000000000001},"max":{"1min":0.64600000000000002,"5min":0.75,"15min":0.75},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Sep 17 10:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.61099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.747,"5min":0.82499999999999996,"15min":1.0629999999999999},"last":0.60099999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740575,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465800,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906040,"statfs":{"total":96636764160,"available":96159784960,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:52:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.45100000000000001,"5min":0.40200000000000002,"15min":0.379},"max":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.77200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.77300000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Sep 17 10:52:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.45600000000000002,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.83399999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.53000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.62}]}]},{"osd":0,"up_from":8,"seq":34359740578,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:52:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73399999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.623,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.70899999999999996,"5min":1.054,"15min":1.054},"last":0.57799999999999996}]},{"osd":2,"last update":"Tue Sep 17 10:52:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.65300000000000002,"5min":0.73399999999999999,"15min":1.0389999999999999},"last":0.63},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":0.75,"5min":0.91500000000000004,"15min":0.99299999999999999},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:53:05.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:53:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:53:05.516 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:53:05.527 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5660,"stamp":"2024-09-17T10:53:03.557871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26757,"ondisk_log_size":26757,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292284,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823236,"statfs":{"total":289910292480,"available":288586993664,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003162"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"164'952","reported_seq":1882,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.847237+0000","last_change":"2024-09-17T07:55:46.260014+0000","last_active":"2024-09-17T08:53:28.847237+0000","last_peered":"2024-09-17T08:53:28.847237+0000","last_clean":"2024-09-17T08:53:28.847237+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T08:53:28.847237+0000","last_undegraded":"2024-09-17T08:53:28.847237+0000","last_fullsized":"2024-09-17T08:53:28.847237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:13.546583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"164'1454","reported_seq":2450,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.845731+0000","last_change":"2024-09-17T07:55:46.260362+0000","last_active":"2024-09-17T08:53:28.845731+0000","last_peered":"2024-09-17T08:53:28.845731+0000","last_clean":"2024-09-17T08:53:28.845731+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T08:53:28.845731+0000","last_undegraded":"2024-09-17T08:53:28.845731+0000","last_fullsized":"2024-09-17T08:53:28.845731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1454,"log_dups_size":0,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:58.525227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8367,"ondisk_log_size":8367,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740571,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424748,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947092,"statfs":{"total":96636764160,"available":96201822208,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.51500000000000001},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.40699999999999997},"max":{"1min":0.59099999999999997,"5min":0.68899999999999995,"15min":0.72199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.45200000000000001},"max":{"1min":0.64600000000000002,"5min":0.75,"15min":0.75},"last":0.53000000000000003}]},{"osd":1,"last update":"Tue Sep 17 10:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.61099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.747,"5min":0.82499999999999996,"15min":1.0629999999999999},"last":0.60099999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740575,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465800,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906040,"statfs":{"total":96636764160,"available":96159784960,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:52:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.45100000000000001,"5min":0.40200000000000002,"15min":0.379},"max":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.77200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.77300000000000002},"last":0.67900000000000005}]},{"osd":2,"last update":"Tue Sep 17 10:52:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.45600000000000002,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.83399999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.53000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.62}]}]},{"osd":0,"up_from":8,"seq":34359740578,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:52:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73399999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.623,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.70899999999999996,"5min":1.054,"15min":1.054},"last":0.57799999999999996}]},{"osd":2,"last update":"Tue Sep 17 10:52:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.65300000000000002,"5min":0.73399999999999999,"15min":1.0389999999999999},"last":0.63},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":0.75,"5min":0.91500000000000004,"15min":0.99299999999999999},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:53:05.528 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T10:53:05.528 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:53:05.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:05.779+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:05.793 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:05.787+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:05.809 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:53:05.813 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:53:05.823 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5661,"stamp":"2024-09-17T10:53:05.558402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26757,"ondisk_log_size":26757,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292284,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823236,"statfs":{"total":289910292480,"available":288586993664,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003205"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"164'952","reported_seq":1882,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.847237+0000","last_change":"2024-09-17T07:55:46.260014+0000","last_active":"2024-09-17T08:53:28.847237+0000","last_peered":"2024-09-17T08:53:28.847237+0000","last_clean":"2024-09-17T08:53:28.847237+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T08:53:28.847237+0000","last_undegraded":"2024-09-17T08:53:28.847237+0000","last_fullsized":"2024-09-17T08:53:28.847237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:13.546583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"164'1454","reported_seq":2450,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.845731+0000","last_change":"2024-09-17T07:55:46.260362+0000","last_active":"2024-09-17T08:53:28.845731+0000","last_peered":"2024-09-17T08:53:28.845731+0000","last_clean":"2024-09-17T08:53:28.845731+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T08:53:28.845731+0000","last_undegraded":"2024-09-17T08:53:28.845731+0000","last_fullsized":"2024-09-17T08:53:28.845731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1454,"log_dups_size":0,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:58.525227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8367,"ondisk_log_size":8367,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740572,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424748,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947092,"statfs":{"total":96636764160,"available":96201822208,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.50900000000000001,"15min":0.51500000000000001},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.40699999999999997},"max":{"1min":0.59099999999999997,"5min":0.68899999999999995,"15min":0.72199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.45200000000000001},"max":{"1min":0.64600000000000002,"5min":0.75,"15min":0.75},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Sep 17 10:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.58799999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":0.73099999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.61099999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.747,"5min":0.82499999999999996,"15min":1.0629999999999999},"last":0.73099999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740576,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465800,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906040,"statfs":{"total":96636764160,"available":96159784960,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:52:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.45100000000000001,"5min":0.40200000000000002,"15min":0.379},"max":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.77200000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.77300000000000002},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Sep 17 10:52:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.626,"15min":0.61199999999999999},"min":{"1min":0.503,"5min":0.45600000000000002,"15min":0.45200000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.83399999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.53000000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740579,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:52:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73399999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.623,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.70899999999999996,"5min":1.054,"15min":1.054},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Sep 17 10:52:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.65300000000000002,"5min":0.73399999999999999,"15min":1.0389999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.67200000000000004},"min":{"1min":0.55700000000000005,"5min":0.54600000000000004,"15min":0.51900000000000002},"max":{"1min":0.75,"5min":0.91500000000000004,"15min":0.99299999999999999},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:53:05.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T10:53:06.114 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:53:06.114 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":166,"fsid":"60881366-2a57-49f8-b8db-3c3284f0e07f","created":"2024-09-17T07:49:38.175175+0000","modified":"2024-09-17T08:54:08.847154+0000","last_up_change":"2024-09-17T07:49:47.682068+0000","last_in_change":"2024-09-17T07:49:38.930014+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T07:49:48.588254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T07:49:53.457478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"20","last_force_op_resend_prenautilus":"20","last_force_op_resend_preluminous":"20","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2024-09-17T07:50:00.751354+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"20","last_force_op_resend_prenautilus":"20","last_force_op_resend_preluminous":"20","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"23d0ff8a-1923-4c3e-9c72-968848969523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6809","nonce":21058},{"type":"v1","addr":"172.21.15.184:6811","nonce":21058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6813","nonce":21058},{"type":"v1","addr":"172.21.15.184:6815","nonce":21058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":21058},{"type":"v1","addr":"172.21.15.184:6823","nonce":21058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":21058},{"type":"v1","addr":"172.21.15.184:6819","nonce":21058}]},"public_addr":"172.21.15.184:6811/21058","cluster_addr":"172.21.15.184:6815/21058","heartbeat_back_addr":"172.21.15.184:6823/21058","heartbeat_front_addr":"172.21.15.184:6819/21058","state":["exists","up"]},{"osd":1,"uuid":"9ddb2de1-07a7-43fa-9ea7-64ebae8dff0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":21060},{"type":"v1","addr":"172.21.15.184:6801","nonce":21060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":21060},{"type":"v1","addr":"172.21.15.184:6803","nonce":21060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":21060},{"type":"v1","addr":"172.21.15.184:6807","nonce":21060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":21060},{"type":"v1","addr":"172.21.15.184:6805","nonce":21060}]},"public_addr":"172.21.15.184:6801/21060","cluster_addr":"172.21.15.184:6803/21060","heartbeat_back_addr":"172.21.15.184:6807/21060","heartbeat_front_addr":"172.21.15.184:6805/21060","state":["exists","up"]},{"osd":2,"uuid":"74335336-a05f-4125-b9fc-aeda243d4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":21059},{"type":"v1","addr":"172.21.15.184:6810","nonce":21059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":21059},{"type":"v1","addr":"172.21.15.184:6814","nonce":21059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":21059},{"type":"v1","addr":"172.21.15.184:6822","nonce":21059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":21059},{"type":"v1","addr":"172.21.15.184:6818","nonce":21059}]},"public_addr":"172.21.15.184:6810/21059","cluster_addr":"172.21.15.184:6814/21059","heartbeat_back_addr":"172.21.15.184:6822/21059","heartbeat_front_addr":"172.21.15.184:6818/21059","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.414580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.122470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T07:49:44.363916+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T10:53:06.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:06.759+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:06.787 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:06.783+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:07.130 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T10:53:07.130 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T10:53:07.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:07.743+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:07.780 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:07.775+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:08.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:08.699+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:08.769 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:08.763+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:09.685 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:09.679+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:09.758 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:09.751+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:10.641 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:10.635+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:10.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:10.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:11.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:11.683+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:11.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:11.715+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:12.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:12.679+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:12.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:12.727+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:13.711 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:13.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:13.714 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:13.706+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:14.691 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:14.686+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:14.734 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:14.726+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:15.648 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:15.642+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:15.729 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:15.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:16.642 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:16.634+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:16.725 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:16.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:17.612 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:17.606+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:17.735 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:17.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:18.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:18.570+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:18.744 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:18.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:19.617 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:19.610+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:19.709 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:19.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:20.668 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:20.662+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:20.726 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:20.718+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:21.700 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:21.694+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:21.705 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:21.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:22.734 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:22.726+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:22.743 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:22.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:23.706 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:23.698+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:23.749 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:23.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:24.737 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:24.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:24.738 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:24.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:25.718 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:25.710+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:25.739 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:25.734+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:26.730 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:26.722+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:26.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:26.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:27.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:27.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:27.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:27.766+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:28.798 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:28.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:28.802 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:28.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:29.767 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:29.762+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:29.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:29.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:30.753 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:30.746+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:30.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:30.794+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:31.708 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:31.702+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:31.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:31.758+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:32.675 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:32.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:32.755 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:32.750+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:33.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:33.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:33.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:33.758+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:34.604 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:34.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:34.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:34.738+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:35.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:35.642+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:35.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:35.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:36.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:36.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:36.693 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:36.686+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:37.600 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:37.594+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:37.712 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:37.706+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:38.623 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:38.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:38.676 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:38.670+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:39.607 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:39.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:39.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:39.702+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:40.566 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:40.558+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:40.711 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:40.706+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:41.535 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:41.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:41.686 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:41.678+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:42.577 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:42.570+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:42.732 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:42.726+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:43.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:43.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:43.741 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:43.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:44.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:44.542+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:44.724 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:44.718+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:45.533 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:45.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:45.763 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:45.758+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:46.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:46.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:46.740 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:46.734+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:47.491 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:47.486+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:47.736 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:47.730+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:48.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:48.530+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:48.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:48.758+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:49.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:49.550+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:49.773 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:49.766+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:50.521 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:50.514+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:50.746 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:50.738+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:51.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:51.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:51.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:51.786+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:52.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:52.478+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:52.823 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:52.814+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:53.489 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:53.482+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:53.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:53.806+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:54.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:54.442+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:54.771 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:54.766+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:55.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:55.414+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:55.788 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:55.782+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:56.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:56.378+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:56.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:56.754+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:57.358 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:57.350+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:57.797 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:57.790+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:58.404 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:58.398+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:58.771 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:58.766+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:59.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:53:59.370+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:53:59.731 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:53:59.726+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:00.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:00.393+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:00.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:00.717+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:01.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:01.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:01.697 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:01.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:02.373 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:02.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:02.660 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:02.653+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:03.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:03.405+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:03.635 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:03.629+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:04.446 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:04.437+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:04.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:04.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:05.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:05.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:05.671 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:05.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:06.409 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:06.405+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:06.651 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:06.645+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:07.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:07.425+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:07.614 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:07.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:08.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:08.397+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:08.593 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:08.589+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:09.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:09.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:09.579 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:09.577+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:10.366 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:10.361+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:10.557 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:10.553+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:11.381 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:11.377+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:11.550 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:11.545+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:12.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:12.385+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:12.601 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:12.597+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:13.406 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:13.401+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:13.629 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:13.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:14.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:14.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:14.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:14.617+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:15.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:15.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:15.647 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:15.641+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:16.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:16.417+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:16.675 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:16.673+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:17.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:17.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:17.690 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:17.685+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:18.457 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:18.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:18.651 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:18.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:19.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:19.481+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:19.653 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:19.649+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:20.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:20.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:20.611 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:20.609+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:21.414 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:21.409+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:21.603 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:21.601+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:22.390 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:22.385+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:22.615 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:22.613+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:23.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:23.353+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:23.628 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:23.625+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:24.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:24.341+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:24.669 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:24.665+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:25.331 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:25.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:25.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:25.681+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:26.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:26.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:26.728 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:26.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:27.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:27.417+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:27.708 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:27.705+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:28.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:28.413+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:28.729 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:28.725+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:29.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:29.425+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:29.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:29.769+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:30.439 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:30.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:30.752 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:30.749+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:31.436 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:31.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:31.717 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:31.713+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:32.458 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:32.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:32.692 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:32.689+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:33.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:33.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:33.735 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:33.729+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:34.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:34.437+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:34.742 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:34.737+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:35.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:35.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:35.758 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:35.753+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:36.452 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:36.449+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:36.750 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:36.745+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:37.424 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:37.421+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:37.796 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:37.793+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:38.386 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:38.381+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:38.790 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:38.785+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:39.370 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:39.365+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:39.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:39.801+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:40.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:40.325+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:40.769 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:40.765+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:41.361 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:41.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:41.723 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:41.721+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:42.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:42.357+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:42.698 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:42.693+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:43.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:43.353+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:43.674 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:43.669+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:44.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:44.389+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:44.677 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:44.673+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:45.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:45.361+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:45.677 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:45.673+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:46.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:46.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:46.664 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:46.660+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:47.326 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:47.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:47.620 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:47.616+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:48.355 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:48.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:48.637 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:48.632+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:49.382 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:49.376+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:49.626 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:49.620+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:50.335 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:50.332+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:50.658 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:50.652+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:51.352 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:51.348+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:51.701 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:51.696+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:52.328 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:52.324+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:52.684 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:52.680+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:53.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:53.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:53.709 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:53.704+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:54.303 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:54.300+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:54.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:54.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:55.346 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:55.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:55.793 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:55.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:56.336 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:56.332+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:56.803 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:56.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:57.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:57.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:57.794 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:57.788+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:58.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:58.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:58.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:58.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:59.421 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:54:59.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:54:59.840 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:54:59.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:00.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:00.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:00.813 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:00.808+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:01.433 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:01.428+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:01.778 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:01.772+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:02.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:02.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:02.748 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:02.744+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:03.384 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:03.380+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:03.772 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:03.768+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:04.388 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:04.384+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:04.759 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:04.756+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:05.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:05.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:05.784 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:05.780+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:06.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:06.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:06.755 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:06.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:07.154 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T10:55:07.155 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T10:55:07.155 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T10:55:07.362 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:07.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:07.743 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:07.740+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:08.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:08.368+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:08.783 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:08.776+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:09.389 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:09.384+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:09.765 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:09.752+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:10.349 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:10.344+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:10.795 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:10.792+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:11.374 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:11.368+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:11.753 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:11.748+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:12.356 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:12.352+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:12.802 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:12.796+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:13.323 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:13.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:13.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:13.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:14.277 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:14.272+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:14.804 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:14.800+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:15.316 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:15.312+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:15.855 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:15.852+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:16.324 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:16.320+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:16.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:16.884+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:17.375 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:17.372+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:17.916 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:17.912+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:18.329 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:18.324+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:18.872 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:18.868+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:19.343 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:19.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:19.863 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:19.860+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:20.371 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:20.368+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:20.870 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:20.864+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:21.372 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:21.368+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:21.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:21.856+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:22.359 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:22.356+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:22.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:22.900+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:23.344 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:23.340+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:23.936 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:23.932+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:24.370 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:24.364+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:24.933 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:24.928+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:25.393 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:25.388+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:25.968 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:25.964+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:26.438 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:26.432+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:26.946 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:26.940+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:27.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:27.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:27.929 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:27.924+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:28.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:28.492+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:28.892 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:28.888+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:29.498 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:29.492+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:29.845 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:29.840+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:30.517 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:30.508+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:30.849 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:30.844+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:31.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:31.524+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:31.839 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:31.836+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:32.504 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:32.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:32.859 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:32.855+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:33.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:33.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:33.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:33.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:34.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:34.503+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:34.832 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:34.827+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:35.492 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:35.487+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:35.818 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:35.811+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:36.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:36.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:36.847 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:36.843+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:37.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:37.563+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:37.887 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:37.883+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:38.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:38.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:38.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:38.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:39.549 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:39.543+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:39.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:39.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:40.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:40.547+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:40.922 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:40.915+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:41.592 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:41.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:41.903 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:41.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:42.558 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:42.551+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:42.875 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:42.871+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:43.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:43.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:43.852 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:43.847+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:44.616 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:44.611+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:44.866 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:44.859+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:45.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:45.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:45.894 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:45.887+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:46.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:46.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:46.928 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:46.923+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:47.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:47.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:47.906 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:47.899+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:48.597 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:48.591+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:48.949 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:48.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:49.610 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:49.603+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:49.972 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:49.967+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:50.645 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:50.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:50.926 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:50.919+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:51.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:51.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:51.935 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:51.931+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:52.622 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:52.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:52.916 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:52.911+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:53.575 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:53.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:53.939 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:53.935+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:54.574 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:54.567+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:54.950 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:54.943+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:55.612 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:55.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:55.922 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:55.915+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:56.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:56.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:56.959 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:56.955+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:57.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:57.543+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:58.009 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:58.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:58.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:58.495+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:58.996 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:58.991+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:55:59.474 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:55:59.467+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:00.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:55:59.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:00.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:00.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:01.010 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:01.003+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:01.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:01.527+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:02.037 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:02.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:02.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:02.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:03.042 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:03.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:03.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:03.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:04.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:04.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:04.614 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:04.607+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:05.053 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:05.047+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:05.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:05.583+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:06.046 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:06.039+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:06.576 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:06.571+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:07.061 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:07.055+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:07.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:07.539+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:08.040 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:08.035+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:08.594 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:08.587+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:09.038 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:09.031+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:09.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:09.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:10.028 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:10.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:10.620 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:10.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:10.991 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:10.987+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:11.644 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:11.639+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:12.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:12.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:12.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:12.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:13.011 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:13.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:13.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:13.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:13.967 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:13.963+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:14.658 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:14.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:15.013 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:15.007+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:15.640 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:15.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:16.049 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:16.043+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:16.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:16.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:17.002 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:16.995+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:17.641 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:17.631+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:18.027 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:18.023+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:18.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:18.650+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:19.000 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:18.994+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:19.618 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:19.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:20.015 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:20.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:20.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:20.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:21.016 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:21.010+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:21.542 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:21.538+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:22.019 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:22.014+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:22.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:22.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:23.064 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:23.058+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:23.585 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:23.578+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:24.088 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:24.082+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:24.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:24.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:25.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:25.118+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:25.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:25.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:26.084 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:26.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:26.596 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:26.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:27.126 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:27.118+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:27.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:27.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:28.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:28.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:28.554 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:28.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:29.086 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:29.078+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:29.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:29.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:30.077 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:30.070+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:30.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:30.538+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:31.067 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:31.062+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:31.569 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:31.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:32.101 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:32.094+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:32.597 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:32.590+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:33.152 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:33.146+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:33.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:33.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:34.168 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:34.162+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:34.608 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:34.602+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:35.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:35.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:35.636 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:35.630+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:36.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:36.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:36.603 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:36.598+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:37.216 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:37.210+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:37.617 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:37.610+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:38.214 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:38.206+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:38.613 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:38.606+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:39.239 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:39.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:39.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:39.614+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:40.203 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:40.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:40.588 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:40.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:41.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:41.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:41.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:41.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:42.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:42.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:42.520 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:42.514+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:43.205 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:43.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:43.544 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:43.538+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:44.242 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:44.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:44.573 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:44.566+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:45.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:45.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:45.568 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:45.562+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:46.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:46.226+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:46.543 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:46.538+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:47.263 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:47.258+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:47.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:47.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:48.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:48.214+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:48.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:48.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:49.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:49.230+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:49.514 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:49.506+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:50.255 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:50.250+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:50.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:50.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:51.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:51.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:51.530 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:51.522+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:52.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:52.302+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:52.580 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:52.574+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:53.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:53.266+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:53.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:53.546+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:54.248 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:54.242+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:54.516 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:54.510+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:55.203 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:55.198+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:55.504 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:55.498+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:56.224 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:56.218+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:56.532 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:56.526+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:57.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:57.234+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:57.559 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:57.554+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:58.246 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:58.238+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:58.589 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:58.582+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:59.264 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:56:59.258+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:56:59.628 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:56:59.622+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:00.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:00.250+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:00.654 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:00.646+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:01.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:01.302+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:01.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:01.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:02.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:02.338+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:02.665 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:02.658+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:03.307 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:03.302+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:03.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:03.658+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:04.277 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:04.270+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:04.624 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:04.618+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:05.327 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:05.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:05.584 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:05.577+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:06.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:06.361+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:06.555 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:06.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:07.179 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-17T10:57:07.180 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T10:57:07.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T10:57:07.326 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-09-17T10:57:07.327 INFO:teuthology.orchestra.run.smithi184.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T10:57:07.327 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-09-17T10:57:07.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T10:57:07.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:07.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:07.518 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:07.509+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:07.636 INFO:teuthology.orchestra.run.smithi184.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T10:57:07.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:57:07.949 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:57:07.951 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:57:07.960 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5782,"stamp":"2024-09-17T10:57:07.625449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26757,"ondisk_log_size":26757,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292284,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823236,"statfs":{"total":289910292480,"available":288586993664,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003587"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"164'952","reported_seq":1882,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.847237+0000","last_change":"2024-09-17T07:55:46.260014+0000","last_active":"2024-09-17T08:53:28.847237+0000","last_peered":"2024-09-17T08:53:28.847237+0000","last_clean":"2024-09-17T08:53:28.847237+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T08:53:28.847237+0000","last_undegraded":"2024-09-17T08:53:28.847237+0000","last_fullsized":"2024-09-17T08:53:28.847237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:13.546583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"164'1454","reported_seq":2450,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.845731+0000","last_change":"2024-09-17T07:55:46.260362+0000","last_active":"2024-09-17T08:53:28.845731+0000","last_peered":"2024-09-17T08:53:28.845731+0000","last_clean":"2024-09-17T08:53:28.845731+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T08:53:28.845731+0000","last_undegraded":"2024-09-17T08:53:28.845731+0000","last_fullsized":"2024-09-17T08:53:28.845731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1454,"log_dups_size":0,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:58.525227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8367,"ondisk_log_size":8367,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740620,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424748,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947092,"statfs":{"total":96636764160,"available":96201822208,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"max":{"1min":0.55000000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.53100000000000003,"5min":0.48299999999999998,"15min":0.46300000000000002},"max":{"1min":0.65900000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Tue Sep 17 10:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.74199999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.59699999999999998,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.83799999999999997},"last":0.65600000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740625,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465800,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906040,"statfs":{"total":96636764160,"available":96159784960,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:56:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.747,"5min":0.75600000000000001,"15min":0.77200000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.71199999999999997,"5min":1.647,"15min":1.647},"last":0.629}]},{"osd":2,"last update":"Tue Sep 17 10:56:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.83399999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.50800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.75700000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.68200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740627,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.46800000000000003,"5min":0.41599999999999998,"15min":0.39300000000000002},"max":{"1min":0.63900000000000001,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.624},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.71099999999999997,"5min":0.81100000000000005,"15min":1.054},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Sep 17 10:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42199999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.60799999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.99299999999999999},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:57:07.966 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.966 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.966 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.967 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.967 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.967 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.967 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.967 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.968 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.968 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.968 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.968 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.968 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:07.968 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:57:08.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:08.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:08.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:08.513+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:09.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:09.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:09.501 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:09.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:10.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:10.393+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:10.499 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:10.493+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:11.357 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:11.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:11.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:11.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:12.348 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:12.341+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:12.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:12.509+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:13.375 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:13.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:13.545 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:13.541+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:14.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:14.397+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:14.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:14.509+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:15.356 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:15.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:15.511 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:15.509+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:16.331 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:16.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:16.486 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:16.481+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:17.336 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:17.333+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:17.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:17.521+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:18.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:18.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:18.493 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:18.489+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:19.318 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:19.313+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:19.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:19.441+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:20.309 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:20.305+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:20.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:20.437+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:21.281 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:21.277+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:21.415 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:21.413+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:22.326 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:22.321+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:22.377 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:22.373+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:23.332 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:23.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:23.391 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:23.389+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:24.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:24.369+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:24.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:24.397+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:25.398 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:25.393+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:25.400 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:25.397+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:26.394 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:26.389+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:26.439 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:26.437+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:27.435 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:27.433+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:27.447 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:27.445+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:27.970 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:57:28.264 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:57:28.266 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:57:28.277 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5792,"stamp":"2024-09-17T10:57:27.631112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26829,"ondisk_log_size":26829,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292276,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823244,"statfs":{"total":289910292480,"available":288587001856,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003571"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8439,"ondisk_log_size":8439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740624,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"max":{"1min":0.55000000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.53100000000000003,"5min":0.48299999999999998,"15min":0.46300000000000002},"max":{"1min":0.65900000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Sep 17 10:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.74199999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.59699999999999998,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.83799999999999997},"last":0.68999999999999995}]}]},{"osd":1,"up_from":8,"seq":34359740629,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:56:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.747,"5min":0.75600000000000001,"15min":0.77200000000000002},"last":0.432},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.71199999999999997,"5min":1.647,"15min":1.647},"last":0.55500000000000005}]},{"osd":2,"last update":"Tue Sep 17 10:56:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.83399999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.50800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.75700000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53100000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740631,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.46800000000000003,"5min":0.41599999999999998,"15min":0.39300000000000002},"max":{"1min":0.63900000000000001,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.61499999999999999,"15min":0.624},"min":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.71099999999999997,"5min":0.81100000000000005,"15min":1.054},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Sep 17 10:56:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.44800000000000001,"15min":0.42199999999999999},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.60799999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.99299999999999999},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:57:28.279 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.279 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.279 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.279 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.280 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.280 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.280 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.280 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.280 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.281 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.281 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:28.281 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:57:28.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:28.437+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:28.440 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:28.437+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:29.456 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:29.453+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:29.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:29.477+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:30.503 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:30.501+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:30.509 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:30.505+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:31.461 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:31.457+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:31.493 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:31.489+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:32.471 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:32.469+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:32.507 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:32.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:33.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:33.477+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:33.502 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:33.497+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:34.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:34.433+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:34.510 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:34.505+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:35.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:35.417+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:35.526 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:35.521+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:36.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:36.421+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:36.565 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:36.561+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:37.423 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:37.421+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:37.534 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:37.529+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:38.469 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:38.465+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:38.539 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:38.537+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:39.479 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:39.477+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:39.522 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:39.517+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:40.446 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:40.441+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:40.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:40.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:41.408 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:41.405+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:41.551 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:41.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:42.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:42.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:42.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:42.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:43.455 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:43.453+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:43.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:43.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:44.450 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:44.445+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:44.528 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:44.525+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:45.495 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:45.493+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:45.547 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:45.545+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:46.451 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:46.449+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:46.537 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:46.533+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:47.448 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:47.445+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:47.570 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:47.565+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:48.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:57:48.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:48.401+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:48.560 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:48.557+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:48.580 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:57:48.583 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:57:48.592 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5802,"stamp":"2024-09-17T10:57:47.636889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26829,"ondisk_log_size":26829,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292276,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823244,"statfs":{"total":289910292480,"available":288587001856,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003610"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8439,"ondisk_log_size":8439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740628,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.44800000000000001,"5min":0.42099999999999999,"15min":0.40699999999999997},"max":{"1min":0.55000000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.53100000000000003,"5min":0.48299999999999998,"15min":0.46300000000000002},"max":{"1min":0.65900000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Sep 17 10:56:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.74199999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69199999999999995,"15min":0.69499999999999995},"min":{"1min":0.59699999999999998,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.83799999999999997},"last":0.72999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740633,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:56:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.747,"5min":0.75600000000000001,"15min":0.77200000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.71199999999999997,"5min":1.647,"15min":1.647},"last":0.58799999999999997}]},{"osd":2,"last update":"Tue Sep 17 10:56:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.73299999999999998,"5min":0.77500000000000002,"15min":0.83399999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.50800000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.75700000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740635,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63700000000000001,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":0.81100000000000005,"15min":1.054},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Sep 17 10:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.42199999999999999},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.56100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.99299999999999999},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:57:48.594 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.594 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.594 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.594 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.594 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.595 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.595 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.595 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.595 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.595 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.595 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:57:48.596 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:57:49.383 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:49.381+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:49.595 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:49.593+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:50.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:50.413+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:50.553 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:50.549+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:51.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:51.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:51.506 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:51.500+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:52.418 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:52.412+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:52.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:52.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:53.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:53.408+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:53.476 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:53.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:54.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:54.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:54.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:54.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:55.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:55.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:55.413 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:55.408+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:56.405 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:56.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:56.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:56.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:57.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:57.448+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:57.462 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:57.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:58.449 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:58.444+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:58.477 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:58.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:59.441 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:57:59.436+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:57:59.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:57:59.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:00.401 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:00.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:00.413 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:00.404+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:01.367 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:01.364+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:01.449 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:01.444+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:02.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:02.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:02.483 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:02.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:03.428 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:03.424+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:03.475 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:03.472+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:04.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:04.448+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:04.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:04.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:05.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:05.432+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:05.441 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:05.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:06.431 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:06.428+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:06.473 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:06.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:07.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:07.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:07.453 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:07.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:08.391 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:08.388+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:08.455 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:08.452+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:08.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:58:08.893 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:58:08.896 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:58:08.906 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5812,"stamp":"2024-09-17T10:58:07.642670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26829,"ondisk_log_size":26829,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292276,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823244,"statfs":{"total":289910292480,"available":288587001856,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003368"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8439,"ondisk_log_size":8439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740632,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.622,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46300000000000002},"max":{"1min":0.64400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.62}]},{"osd":1,"last update":"Tue Sep 17 10:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.72199999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.69499999999999995},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83799999999999997},"last":0.73799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740637,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.65500000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.67200000000000004,"5min":1.647,"15min":1.647},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Sep 17 10:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.63},"min":{"1min":0.495,"5min":0.441,"15min":0.441},"max":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.90700000000000003},"last":0.80800000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740639,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63700000000000001,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":0.81100000000000005,"15min":1.054},"last":0.622}]},{"osd":2,"last update":"Tue Sep 17 10:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.42199999999999999},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.56100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.99299999999999999},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:58:08.907 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.907 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.908 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.908 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.908 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.908 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.908 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.909 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.909 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.909 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.909 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:08.909 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:58:09.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:09.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:09.426 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:09.420+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:10.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:10.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:10.471 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:10.468+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:11.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:11.400+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:11.454 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:11.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:12.402 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:12.396+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:12.466 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:12.460+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:13.388 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:13.384+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:13.440 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:13.436+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:14.344 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:14.340+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:14.420 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:14.416+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:15.300 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:15.296+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:15.469 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:15.464+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:16.333 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:16.328+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:16.485 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:16.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:17.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:17.336+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:17.484 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:17.480+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:18.297 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:18.292+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:18.500 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:18.496+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:19.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:19.280+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:19.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:19.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:20.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:20.248+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:20.467 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:20.464+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:21.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:21.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:21.459 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:21.456+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:22.181 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:22.176+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:22.427 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:22.424+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:23.225 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:23.220+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:23.412 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:23.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:24.262 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:24.256+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:24.365 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:24.360+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:25.273 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:25.268+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:25.364 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:25.360+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:26.291 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:26.288+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:26.358 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:26.352+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:27.265 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:27.260+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:27.339 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:27.336+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:28.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:28.308+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:28.376 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:28.372+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:28.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:58:29.214 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:58:29.217 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:58:29.227 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5822,"stamp":"2024-09-17T10:58:27.648288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26829,"ondisk_log_size":26829,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292276,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823244,"statfs":{"total":289910292480,"available":288587001856,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003517"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8439,"ondisk_log_size":8439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740636,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.622,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46300000000000002},"max":{"1min":0.64400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Sep 17 10:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.72199999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.69499999999999995},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83799999999999997},"last":0.71599999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740641,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.65500000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.67200000000000004,"5min":1.647,"15min":1.647},"last":0.67400000000000004}]},{"osd":2,"last update":"Tue Sep 17 10:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.63},"min":{"1min":0.495,"5min":0.441,"15min":0.441},"max":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.90700000000000003},"last":0.503}]}]},{"osd":0,"up_from":8,"seq":34359740643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63700000000000001,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":0.81100000000000005,"15min":1.054},"last":0.53500000000000003}]},{"osd":2,"last update":"Tue Sep 17 10:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.42199999999999999},"max":{"1min":0.65800000000000003,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.56100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.99299999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:58:29.228 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.229 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.229 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.229 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.229 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.229 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.229 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.230 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.230 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.230 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.230 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:29.230 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:58:29.268 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:29.264+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:29.378 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:29.372+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:30.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:30.236+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:30.363 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:30.360+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:31.244 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:31.240+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:31.401 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:31.396+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:32.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:32.228+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:32.411 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:32.408+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:33.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:33.212+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:33.425 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:33.420+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:34.219 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:34.216+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:34.451 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:34.448+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:35.206 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:35.200+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:35.445 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:35.440+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:36.175 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:36.172+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:36.405 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:36.400+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:37.192 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:37.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:37.419 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:37.415+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:38.156 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:38.151+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:38.398 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:38.391+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:39.177 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:39.171+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:39.431 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:39.427+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:40.218 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:40.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:40.481 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:40.475+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:41.180 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:41.175+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:41.527 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:41.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:42.187 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:42.183+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:42.504 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:42.499+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:43.147 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:43.143+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:43.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:43.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:44.185 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:44.179+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:44.563 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:44.559+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:45.232 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:45.227+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:45.598 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:45.591+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:46.271 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:46.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:46.583 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:46.579+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:47.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:47.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:47.552 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:47.543+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:48.299 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:48.295+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:48.523 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:48.519+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:49.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:58:49.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:49.311+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:49.497 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:49.491+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:49.527 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:58:49.530 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:58:49.540 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5832,"stamp":"2024-09-17T10:58:47.653783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26829,"ondisk_log_size":26829,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292276,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823244,"statfs":{"total":289910292480,"available":288587001856,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003351"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8439,"ondisk_log_size":8439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740640,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.622,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.46300000000000002},"max":{"1min":0.64400000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.621}]},{"osd":1,"last update":"Tue Sep 17 10:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.42999999999999999},"max":{"1min":0.72199999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.69499999999999995},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83799999999999997},"last":0.70199999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740645,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.432,"5min":0.42399999999999999,"15min":0.40200000000000002},"max":{"1min":0.65500000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60999999999999999,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.67200000000000004,"5min":1.647,"15min":1.647},"last":0.57199999999999995}]},{"osd":2,"last update":"Tue Sep 17 10:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.621,"15min":0.63},"min":{"1min":0.495,"5min":0.441,"15min":0.441},"max":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.90700000000000003},"last":0.72499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740647,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.48999999999999999,"5min":0.46400000000000002,"15min":0.45600000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.054},"last":0.74199999999999999}]},{"osd":2,"last update":"Tue Sep 17 10:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.627},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:58:49.542 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.542 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.542 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.543 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.543 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.543 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.543 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.544 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.544 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.544 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.544 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:58:49.544 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:58:50.279 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:50.275+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:50.512 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:50.507+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:51.254 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:51.247+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:51.529 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:51.523+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:52.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:52.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:52.538 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:52.531+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:53.226 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:53.219+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:53.541 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:53.535+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:54.192 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:54.187+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:54.582 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:54.579+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:55.209 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:55.203+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:55.629 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:55.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:56.197 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:56.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:56.651 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:56.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:57.207 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:57.203+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:57.650 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:57.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:58.228 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:58.223+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:58.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:58.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:59.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:58:59.239+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:58:59.663 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:58:59.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:00.274 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:00.267+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:00.625 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:00.619+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:01.258 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:01.251+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:01.673 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:01.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:02.238 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:02.231+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:02.647 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:02.643+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:03.236 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:03.231+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:03.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:03.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:04.215 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:04.211+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:04.720 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:04.715+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:05.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:05.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:05.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:05.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:06.298 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:06.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:06.639 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:06.635+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:07.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:07.291+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:07.627 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:07.623+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:08.304 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:08.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:08.621 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:08.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:09.341 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:09.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:09.545 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:59:09.631 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:09.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:09.842 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:59:09.844 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:59:09.859 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5843,"stamp":"2024-09-17T10:59:09.659827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26829,"ondisk_log_size":26829,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292276,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823244,"statfs":{"total":289910292480,"available":288587001856,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003258"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8439,"ondisk_log_size":8439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740645,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46300000000000002},"max":{"1min":0.76800000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.626}]},{"osd":1,"last update":"Tue Sep 17 10:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.78800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83799999999999997},"last":0.70499999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740650,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.40200000000000002},"max":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.434},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.56999999999999995,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.747,"5min":0.747,"15min":1.647},"last":0.60199999999999998}]},{"osd":2,"last update":"Tue Sep 17 10:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.628},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.90700000000000003},"last":0.64500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740652,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.439},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.48999999999999999,"5min":0.46400000000000002,"15min":0.45600000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.054},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Sep 17 10:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:59:09.861 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.861 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.861 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.862 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.862 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.862 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.862 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.863 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.863 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.863 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.863 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:09.863 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:59:10.340 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:10.335+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:10.619 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:10.615+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:11.305 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:11.299+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:11.653 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:11.647+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:12.266 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:12.259+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:12.656 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:12.651+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:13.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:13.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:13.692 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:13.687+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:14.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:14.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:14.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:14.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:15.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:15.283+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:15.630 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:15.627+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:16.320 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:16.315+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:16.674 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:16.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:17.275 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:17.271+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:17.664 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:17.659+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:18.283 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:18.279+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:18.672 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:18.667+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:19.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:19.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:19.667 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:19.663+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:20.196 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:20.191+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:20.710 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:20.703+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:21.220 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:21.215+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:21.716 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:21.711+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:22.250 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:22.243+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:22.678 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:22.671+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:23.241 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:23.235+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:23.662 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:23.654+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:24.257 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:24.250+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:24.677 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:24.670+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:25.278 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:25.270+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:25.727 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:25.722+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:26.311 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:26.306+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:26.712 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:26.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:27.292 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:27.286+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:27.736 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:27.730+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:28.310 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:28.306+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:28.717 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:28.710+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:29.352 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:29.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:29.714 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:29.706+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:29.865 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:59:30.154 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:59:30.157 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:59:30.167 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5853,"stamp":"2024-09-17T10:59:29.665132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26829,"ondisk_log_size":26829,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292276,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823244,"statfs":{"total":289910292480,"available":288587001856,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003218"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1698,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846371+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:53:28.846371+0000","last_peered":"2024-09-17T08:53:28.846371+0000","last_clean":"2024-09-17T08:53:28.846371+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:53:28.846371+0000","last_undegraded":"2024-09-17T08:53:28.846371+0000","last_fullsized":"2024-09-17T08:53:28.846371+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:03:21.068062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1986,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846923+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:53:28.846923+0000","last_peered":"2024-09-17T08:53:28.846923+0000","last_clean":"2024-09-17T08:53:28.846923+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:53:28.846923+0000","last_undegraded":"2024-09-17T08:53:28.846923+0000","last_fullsized":"2024-09-17T08:53:28.846923+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:31.712399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1663,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846794+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:53:28.846794+0000","last_peered":"2024-09-17T08:53:28.846794+0000","last_clean":"2024-09-17T08:53:28.846794+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:53:28.846794+0000","last_undegraded":"2024-09-17T08:53:28.846794+0000","last_fullsized":"2024-09-17T08:53:28.846794+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:18.946937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1878,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846093+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:53:28.846093+0000","last_peered":"2024-09-17T08:53:28.846093+0000","last_clean":"2024-09-17T08:53:28.846093+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:53:28.846093+0000","last_undegraded":"2024-09-17T08:53:28.846093+0000","last_fullsized":"2024-09-17T08:53:28.846093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:08.224517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"164'4311","reported_seq":11369,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846383+0000","last_change":"2024-09-17T07:55:46.249687+0000","last_active":"2024-09-17T08:53:28.846383+0000","last_peered":"2024-09-17T08:53:28.846383+0000","last_clean":"2024-09-17T08:53:28.846383+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T08:53:28.846383+0000","last_undegraded":"2024-09-17T08:53:28.846383+0000","last_fullsized":"2024-09-17T08:53:28.846383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4311,"log_dups_size":0,"ondisk_log_size":4311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:43.647382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"164'986","reported_seq":2103,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846057+0000","last_change":"2024-09-17T07:55:46.249488+0000","last_active":"2024-09-17T08:53:28.846057+0000","last_peered":"2024-09-17T08:53:28.846057+0000","last_clean":"2024-09-17T08:53:28.846057+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T08:53:28.846057+0000","last_undegraded":"2024-09-17T08:53:28.846057+0000","last_fullsized":"2024-09-17T08:53:28.846057+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":986,"log_dups_size":0,"ondisk_log_size":986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:23.215248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13277,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:42.772160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8871,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846161+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:53:28.846161+0000","last_peered":"2024-09-17T08:53:28.846161+0000","last_clean":"2024-09-17T08:53:28.846161+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:53:28.846161+0000","last_undegraded":"2024-09-17T08:53:28.846161+0000","last_fullsized":"2024-09-17T08:53:28.846161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:45.644612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11066,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846071+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:53:28.846071+0000","last_peered":"2024-09-17T08:53:28.846071+0000","last_clean":"2024-09-17T08:53:28.846071+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:53:28.846071+0000","last_undegraded":"2024-09-17T08:53:28.846071+0000","last_fullsized":"2024-09-17T08:53:28.846071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:21.457005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2330,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846666+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:53:28.846666+0000","last_peered":"2024-09-17T08:53:28.846666+0000","last_clean":"2024-09-17T08:53:28.846666+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:53:28.846666+0000","last_undegraded":"2024-09-17T08:53:28.846666+0000","last_fullsized":"2024-09-17T08:53:28.846666+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:38.847279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T08:53:28.846479+0000","last_change":"2024-09-17T07:49:50.353842+0000","last_active":"2024-09-17T08:53:28.846479+0000","last_peered":"2024-09-17T08:53:28.846479+0000","last_clean":"2024-09-17T08:53:28.846479+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T08:53:28.846479+0000","last_undegraded":"2024-09-17T08:53:28.846479+0000","last_fullsized":"2024-09-17T08:53:28.846479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:48.683271+0000","last_clean_scrub_stamp":"2024-09-17T07:49:48.683271+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.719159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18338,"ondisk_log_size":18338,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":223,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8439,"ondisk_log_size":8439,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740649,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46300000000000002},"max":{"1min":0.76800000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64200000000000002}]},{"osd":1,"last update":"Tue Sep 17 10:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.78800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83799999999999997},"last":0.59899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740654,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.40200000000000002},"max":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.56999999999999995,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.747,"5min":0.747,"15min":1.647},"last":0.70899999999999996}]},{"osd":2,"last update":"Tue Sep 17 10:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.628},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.90700000000000003},"last":0.746}]}]},{"osd":0,"up_from":8,"seq":34359740656,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401736,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970104,"statfs":{"total":96636764160,"available":96225386496,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53200000000000003,"15min":0.52900000000000003},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.78300000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.48999999999999999,"5min":0.46400000000000002,"15min":0.45600000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.054},"last":0.53900000000000003}]},{"osd":2,"last update":"Tue Sep 17 10:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.42199999999999999},"max":{"1min":0.69599999999999995,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.496},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:59:30.168 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.169 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.169 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.169 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.172 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.172 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.172 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.173 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.173 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.173 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.173 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T07:49:48.683271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=48, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:30.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2024-09-17T10:59:30.390 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:30.382+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:30.467 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2024-09-17T10:59:30.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2024-09-17T10:59:30.745 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:30.738+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:30.774 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2024-09-17T10:59:30.784 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2024-09-17T10:59:31.073 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2024-09-17T10:59:31.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2024-09-17T10:59:31.371 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2024-09-17T10:59:31.381 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-17T10:59:31.435 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:31.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:31.660 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-17T10:59:31.670 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2024-09-17T10:59:31.757 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:31.750+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:31.979 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2024-09-17T10:59:31.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2024-09-17T10:59:32.270 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2024-09-17T10:59:32.285 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-17T10:59:32.414 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:32.406+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:32.574 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-17T10:59:32.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-17T10:59:32.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:32.774+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:32.880 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-17T10:59:32.893 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2024-09-17T10:59:33.176 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2024-09-17T10:59:33.186 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2024-09-17T10:59:33.400 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:33.394+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:33.474 INFO:teuthology.orchestra.run.smithi184.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2024-09-17T10:59:33.483 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:59:33.801 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:33.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:34.410 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:34.402+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:34.811 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:34.806+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:35.454 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:35.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:35.854 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:35.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:36.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:36.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:36.843 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:36.838+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:37.460 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:37.454+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:37.873 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:37.866+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:38.473 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:38.466+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:38.881 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:38.874+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:39.463 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:39.458+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:39.886 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:39.878+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:40.425 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:40.418+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:40.864 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:40.858+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:41.444 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:41.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:41.900 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:41.894+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:42.468 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:42.462+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:42.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:42.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:43.501 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:43.494+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:43.837 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:43.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:44.477 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:44.470+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:44.791 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:44.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:45.494 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:45.486+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:45.779 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:45.774+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:46.481 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:46.474+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:46.785 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:46.778+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:47.490 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:47.482+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:47.835 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:47.830+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:48.445 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:48.438+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:48.853 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:48.846+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:49.452 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:49.446+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:49.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:49.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:50.432 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:50.426+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:50.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:50.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:51.386 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:51.378+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:51.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:51.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:52.421 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:52.414+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:52.795 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:52.790+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:53.438 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:53.430+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:53.485 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T10:59:53.776 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T10:59:53.780 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T10:59:53.792 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5865,"stamp":"2024-09-17T10:59:53.671472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":371,"num_omap_keys":41,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26950,"ondisk_log_size":26950,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292272,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823248,"statfs":{"total":289910292480,"available":288587005952,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003302"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1699,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853497+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:54:08.853497+0000","last_peered":"2024-09-17T08:54:08.853497+0000","last_clean":"2024-09-17T08:54:08.853497+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:54:08.853497+0000","last_undegraded":"2024-09-17T08:54:08.853497+0000","last_fullsized":"2024-09-17T08:54:08.853497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1987,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853852+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:54:08.853852+0000","last_peered":"2024-09-17T08:54:08.853852+0000","last_clean":"2024-09-17T08:54:08.853852+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:54:08.853852+0000","last_undegraded":"2024-09-17T08:54:08.853852+0000","last_fullsized":"2024-09-17T08:54:08.853852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'839","reported_seq":1664,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853495+0000","last_change":"2024-09-17T07:55:46.253959+0000","last_active":"2024-09-17T08:54:08.853495+0000","last_peered":"2024-09-17T08:54:08.853495+0000","last_clean":"2024-09-17T08:54:08.853495+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T08:54:08.853495+0000","last_undegraded":"2024-09-17T08:54:08.853495+0000","last_fullsized":"2024-09-17T08:54:08.853495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'988","reported_seq":1879,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853568+0000","last_change":"2024-09-17T07:55:46.254290+0000","last_active":"2024-09-17T08:54:08.853568+0000","last_peered":"2024-09-17T08:54:08.853568+0000","last_clean":"2024-09-17T08:54:08.853568+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T08:54:08.853568+0000","last_undegraded":"2024-09-17T08:54:08.853568+0000","last_fullsized":"2024-09-17T08:54:08.853568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"166'4381","reported_seq":11452,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:31.990869+0000","last_change":"2024-09-17T10:59:31.990784+0000","last_active":"2024-09-17T10:59:31.990869+0000","last_peered":"2024-09-17T10:59:31.990869+0000","last_clean":"2024-09-17T10:59:31.990869+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T10:59:31.990869+0000","last_undegraded":"2024-09-17T10:59:31.990869+0000","last_fullsized":"2024-09-17T10:59:31.990869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'4381","last_scrub_stamp":"2024-09-17T10:59:31.990625+0000","last_deep_scrub":"166'4381","last_deep_scrub_stamp":"2024-09-17T10:59:31.990625+0000","last_clean_scrub_stamp":"2024-09-17T10:59:31.990625+0000","objects_scrubbed":70,"log_size":4381,"log_dups_size":0,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:30:19.076028+0000","scrub_duration":0.23644815199999999,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"166'1035","reported_seq":2164,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:44.946247+0000","last_change":"2024-09-17T10:59:44.946161+0000","last_active":"2024-09-17T10:59:44.946247+0000","last_peered":"2024-09-17T10:59:44.946247+0000","last_clean":"2024-09-17T10:59:44.946247+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T10:59:44.946247+0000","last_undegraded":"2024-09-17T10:59:44.946247+0000","last_fullsized":"2024-09-17T10:59:44.946247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1035","last_scrub_stamp":"2024-09-17T10:59:44.946032+0000","last_deep_scrub":"166'1035","last_deep_scrub_stamp":"2024-09-17T10:59:44.946032+0000","last_clean_scrub_stamp":"2024-09-17T10:59:44.946032+0000","objects_scrubbed":49,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:10:04.840746+0000","scrub_duration":0.157516354,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13278,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.852520+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:54:08.852520+0000","last_peered":"2024-09-17T08:54:08.852520+0000","last_clean":"2024-09-17T08:54:08.852520+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:54:08.852520+0000","last_undegraded":"2024-09-17T08:54:08.852520+0000","last_fullsized":"2024-09-17T08:54:08.852520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'3485","reported_seq":8872,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.852652+0000","last_change":"2024-09-17T07:55:46.250175+0000","last_active":"2024-09-17T08:54:08.852652+0000","last_peered":"2024-09-17T08:54:08.852652+0000","last_clean":"2024-09-17T08:54:08.852652+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T08:54:08.852652+0000","last_undegraded":"2024-09-17T08:54:08.852652+0000","last_fullsized":"2024-09-17T08:54:08.852652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":3485,"log_dups_size":0,"ondisk_log_size":3485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11067,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853526+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:54:08.853526+0000","last_peered":"2024-09-17T08:54:08.853526+0000","last_clean":"2024-09-17T08:54:08.853526+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:54:08.853526+0000","last_undegraded":"2024-09-17T08:54:08.853526+0000","last_fullsized":"2024-09-17T08:54:08.853526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2331,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853405+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:54:08.853405+0000","last_peered":"2024-09-17T08:54:08.853405+0000","last_clean":"2024-09-17T08:54:08.853405+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:54:08.853405+0000","last_undegraded":"2024-09-17T08:54:08.853405+0000","last_fullsized":"2024-09-17T08:54:08.853405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"166'54","reported_seq":242,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:45.503060+0000","last_change":"2024-09-17T10:59:45.502997+0000","last_active":"2024-09-17T10:59:45.503060+0000","last_peered":"2024-09-17T10:59:45.503060+0000","last_clean":"2024-09-17T10:59:45.503060+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T10:59:45.503060+0000","last_undegraded":"2024-09-17T10:59:45.503060+0000","last_fullsized":"2024-09-17T10:59:45.503060+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'54","last_scrub_stamp":"2024-09-17T10:59:45.502750+0000","last_deep_scrub":"166'54","last_deep_scrub_stamp":"2024-09-17T10:59:45.502750+0000","last_clean_scrub_stamp":"2024-09-17T10:59:45.502750+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:04:16.115005+0000","scrub_duration":0.010341426000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18408,"ondisk_log_size":18408,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":371,"num_omap_keys":41,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8488,"ondisk_log_size":8488,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740653,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51400000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.46300000000000002},"max":{"1min":0.76800000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Tue Sep 17 10:58:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47299999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.78800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83799999999999997},"last":0.70299999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740658,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.40200000000000002},"max":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60799999999999998},"min":{"1min":0.56999999999999995,"5min":0.46899999999999997,"15min":0.46700000000000003},"max":{"1min":0.747,"5min":0.747,"15min":1.647},"last":0.66800000000000004}]},{"osd":2,"last update":"Tue Sep 17 10:58:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.62,"15min":0.61499999999999999},"min":{"1min":0.47199999999999998,"5min":0.46899999999999997,"15min":0.45200000000000001},"max":{"1min":0.72099999999999997,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.62,"15min":0.628},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.90700000000000003},"last":0.624}]}]},{"osd":0,"up_from":8,"seq":34359740660,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401732,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970108,"statfs":{"total":96636764160,"available":96225390592,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.78300000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.054},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Sep 17 10:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.73199999999999998,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.82599999999999996,"5min":1.012,"15min":1.012},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T10:59:53.794 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.794 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.795 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.795 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.795 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.795 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.795 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.796 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T10:59:53.796 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T10:59:53.799 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:53.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:54.396 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:54.390+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:54.775 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:54.770+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:55.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:55.370+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:55.750 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:55.742+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:56.378 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:56.374+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:56.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:56.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:57.380 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:57.374+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:57.792 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:57.786+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:58.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:58.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:58.807 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:58.802+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:59.314 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T10:59:59.310+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T10:59:59.856 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T10:59:59.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:00.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:00.298+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:00.832 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:00.826+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:01.306 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:01.298+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:01.818 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:01.810+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:02.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:02.262+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:02.842 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:02.834+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:03.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:03.270+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:03.819 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:03.814+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:04.289 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:04.282+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:04.827 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:04.822+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:05.339 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:05.334+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:05.800 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:05.794+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:06.353 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:06.346+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:06.850 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:06.842+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:07.368 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:07.362+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:07.889 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:07.882+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:08.404 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:08.398+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:08.855 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:08.850+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:09.361 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:09.354+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:09.841 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:09.833+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:10.374 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:10.365+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:10.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:10.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:11.361 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:11.353+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:11.894 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:11.885+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:12.343 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:12.337+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:12.887 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:12.881+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:13.358 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:13.349+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:13.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T11:00:13.862 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:13.853+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:14.093 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T11:00:14.096 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T11:00:14.107 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5875,"stamp":"2024-09-17T11:00:13.676794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":447,"num_omap_keys":51,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27081,"ondisk_log_size":27081,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292272,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823248,"statfs":{"total":289910292480,"available":288587005952,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003177"},"pg_stats":[{"pgid":"2.7","version":"164'785","reported_seq":1699,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853497+0000","last_change":"2024-09-17T07:55:46.255398+0000","last_active":"2024-09-17T08:54:08.853497+0000","last_peered":"2024-09-17T08:54:08.853497+0000","last_clean":"2024-09-17T08:54:08.853497+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T08:54:08.853497+0000","last_undegraded":"2024-09-17T08:54:08.853497+0000","last_fullsized":"2024-09-17T08:54:08.853497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'1033","reported_seq":1987,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853852+0000","last_change":"2024-09-17T07:55:46.254947+0000","last_active":"2024-09-17T08:54:08.853852+0000","last_peered":"2024-09-17T08:54:08.853852+0000","last_clean":"2024-09-17T08:54:08.853852+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T08:54:08.853852+0000","last_undegraded":"2024-09-17T08:54:08.853852+0000","last_fullsized":"2024-09-17T08:54:08.853852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"166'874","reported_seq":1710,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T11:00:07.538353+0000","last_change":"2024-09-17T11:00:07.538292+0000","last_active":"2024-09-17T11:00:07.538353+0000","last_peered":"2024-09-17T11:00:07.538353+0000","last_clean":"2024-09-17T11:00:07.538353+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T11:00:07.538353+0000","last_undegraded":"2024-09-17T11:00:07.538353+0000","last_fullsized":"2024-09-17T11:00:07.538353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'874","last_scrub_stamp":"2024-09-17T11:00:07.538087+0000","last_deep_scrub":"166'874","last_deep_scrub_stamp":"2024-09-17T11:00:07.538087+0000","last_clean_scrub_stamp":"2024-09-17T11:00:07.538087+0000","objects_scrubbed":35,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:27.467642+0000","scrub_duration":0.17201174699999999,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"166'1032","reported_seq":1934,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:49.591683+0000","last_change":"2024-09-17T10:59:49.591620+0000","last_active":"2024-09-17T10:59:49.591683+0000","last_peered":"2024-09-17T10:59:49.591683+0000","last_clean":"2024-09-17T10:59:49.591683+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T10:59:49.591683+0000","last_undegraded":"2024-09-17T10:59:49.591683+0000","last_fullsized":"2024-09-17T10:59:49.591683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1032","last_scrub_stamp":"2024-09-17T10:59:49.591436+0000","last_deep_scrub":"166'1032","last_deep_scrub_stamp":"2024-09-17T10:59:49.591436+0000","last_clean_scrub_stamp":"2024-09-17T10:59:49.591436+0000","objects_scrubbed":44,"log_size":1032,"log_dups_size":0,"ondisk_log_size":1032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:56:25.666993+0000","scrub_duration":0.14220772700000001,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"166'4381","reported_seq":11452,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:31.990869+0000","last_change":"2024-09-17T10:59:31.990784+0000","last_active":"2024-09-17T10:59:31.990869+0000","last_peered":"2024-09-17T10:59:31.990869+0000","last_clean":"2024-09-17T10:59:31.990869+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T10:59:31.990869+0000","last_undegraded":"2024-09-17T10:59:31.990869+0000","last_fullsized":"2024-09-17T10:59:31.990869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'4381","last_scrub_stamp":"2024-09-17T10:59:31.990625+0000","last_deep_scrub":"166'4381","last_deep_scrub_stamp":"2024-09-17T10:59:31.990625+0000","last_clean_scrub_stamp":"2024-09-17T10:59:31.990625+0000","objects_scrubbed":70,"log_size":4381,"log_dups_size":0,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:30:19.076028+0000","scrub_duration":0.23644815199999999,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"166'1035","reported_seq":2164,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:44.946247+0000","last_change":"2024-09-17T10:59:44.946161+0000","last_active":"2024-09-17T10:59:44.946247+0000","last_peered":"2024-09-17T10:59:44.946247+0000","last_clean":"2024-09-17T10:59:44.946247+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T10:59:44.946247+0000","last_undegraded":"2024-09-17T10:59:44.946247+0000","last_fullsized":"2024-09-17T10:59:44.946247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1035","last_scrub_stamp":"2024-09-17T10:59:44.946032+0000","last_deep_scrub":"166'1035","last_deep_scrub_stamp":"2024-09-17T10:59:44.946032+0000","last_clean_scrub_stamp":"2024-09-17T10:59:44.946032+0000","objects_scrubbed":49,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:10:04.840746+0000","scrub_duration":0.157516354,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'6262","reported_seq":13278,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.852520+0000","last_change":"2024-09-17T07:55:46.260068+0000","last_active":"2024-09-17T08:54:08.852520+0000","last_peered":"2024-09-17T08:54:08.852520+0000","last_clean":"2024-09-17T08:54:08.852520+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T08:54:08.852520+0000","last_undegraded":"2024-09-17T08:54:08.852520+0000","last_fullsized":"2024-09-17T08:54:08.852520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":6262,"log_dups_size":0,"ondisk_log_size":6262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"166'3537","reported_seq":8936,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:49.927507+0000","last_change":"2024-09-17T10:59:49.927441+0000","last_active":"2024-09-17T10:59:49.927507+0000","last_peered":"2024-09-17T10:59:49.927507+0000","last_clean":"2024-09-17T10:59:49.927507+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T10:59:49.927507+0000","last_undegraded":"2024-09-17T10:59:49.927507+0000","last_fullsized":"2024-09-17T10:59:49.927507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'3537","last_scrub_stamp":"2024-09-17T10:59:49.927269+0000","last_deep_scrub":"166'3537","last_deep_scrub_stamp":"2024-09-17T10:59:49.927269+0000","last_clean_scrub_stamp":"2024-09-17T10:59:49.927269+0000","objects_scrubbed":52,"log_size":3537,"log_dups_size":0,"ondisk_log_size":3537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:34.343521+0000","scrub_duration":0.12179612099999999,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"164'4280","reported_seq":11067,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853526+0000","last_change":"2024-09-17T07:55:46.255049+0000","last_active":"2024-09-17T08:54:08.853526+0000","last_peered":"2024-09-17T08:54:08.853526+0000","last_clean":"2024-09-17T08:54:08.853526+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T08:54:08.853526+0000","last_undegraded":"2024-09-17T08:54:08.853526+0000","last_fullsized":"2024-09-17T08:54:08.853526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:50:00.801545+0000","last_clean_scrub_stamp":"2024-09-17T07:50:00.801545+0000","objects_scrubbed":0,"log_size":4280,"log_dups_size":0,"ondisk_log_size":4280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"164'1330","reported_seq":2331,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T08:54:08.853405+0000","last_change":"2024-09-17T07:55:46.254573+0000","last_active":"2024-09-17T08:54:08.853405+0000","last_peered":"2024-09-17T08:54:08.853405+0000","last_clean":"2024-09-17T08:54:08.853405+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T08:54:08.853405+0000","last_undegraded":"2024-09-17T08:54:08.853405+0000","last_fullsized":"2024-09-17T08:54:08.853405+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T07:49:53.703659+0000","last_clean_scrub_stamp":"2024-09-17T07:49:53.703659+0000","objects_scrubbed":0,"log_size":1330,"log_dups_size":0,"ondisk_log_size":1330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"166'54","reported_seq":242,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:45.503060+0000","last_change":"2024-09-17T10:59:45.502997+0000","last_active":"2024-09-17T10:59:45.503060+0000","last_peered":"2024-09-17T10:59:45.503060+0000","last_clean":"2024-09-17T10:59:45.503060+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T10:59:45.503060+0000","last_undegraded":"2024-09-17T10:59:45.503060+0000","last_fullsized":"2024-09-17T10:59:45.503060+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'54","last_scrub_stamp":"2024-09-17T10:59:45.502750+0000","last_deep_scrub":"166'54","last_deep_scrub_stamp":"2024-09-17T10:59:45.502750+0000","last_clean_scrub_stamp":"2024-09-17T10:59:45.502750+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:04:16.115005+0000","scrub_duration":0.010341426000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18460,"ondisk_log_size":18460,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":446,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8567,"ondisk_log_size":8567,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740657,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.443,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.60599999999999998,"5min":0.72399999999999998,"15min":0.72999999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.51400000000000001,"5min":0.47799999999999998,"15min":0.46300000000000002},"max":{"1min":0.69699999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Tue Sep 17 10:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.90800000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"last":0.79100000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740662,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.647},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Sep 17 10:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68400000000000005,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.627},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75700000000000001,"5min":0.80800000000000005,"15min":0.90700000000000003},"last":0.64500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740664,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401732,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970108,"statfs":{"total":96636764160,"available":96225390592,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.78300000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.054},"last":0.66800000000000004}]},{"osd":2,"last update":"Tue Sep 17 10:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.73199999999999998,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.82599999999999996,"5min":1.012,"15min":1.012},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T11:00:14.109 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T11:00:14.109 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T11:00:14.109 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T11:00:14.109 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-17T07:50:00.801545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=50, tm_sec=0, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T11:00:14.110 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T07:49:53.703659+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=7, tm_min=49, tm_sec=53, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=10, tm_min=53, tm_sec=6, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T11:00:14.110 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T11:00:14.316 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:14.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:14.817 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:14.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:15.301 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:15.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:15.834 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:15.829+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:16.317 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:16.309+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:16.815 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:16.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:17.350 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:17.345+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:17.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:17.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:18.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:18.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:18.762 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:18.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:19.287 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:19.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:19.798 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:19.793+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:20.334 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:20.329+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:20.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:20.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:21.296 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:21.293+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:21.777 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:21.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:22.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:22.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:22.773 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:22.769+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:23.276 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:23.273+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:23.778 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:23.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:24.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:24.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:24.768 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:24.765+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:25.243 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:25.241+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:25.776 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:25.773+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:26.240 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:26.237+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:26.731 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:26.729+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:27.195 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:27.193+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:27.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:27.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:28.212 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:28.209+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:28.761 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:28.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:29.252 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:29.249+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:29.813 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:29.809+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:30.256 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:30.253+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:30.821 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:30.817+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:31.290 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:31.285+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:31.794 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:31.789+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:32.272 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:32.269+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:32.760 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:32.757+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:33.308 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:33.305+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:33.765 INFO:tasks.ceph.osd.0.smithi184.stderr:2024-09-17T11:00:33.761+0000 7fdbba384700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:820 3.3 3:dcbef67a:test1::rbd_data.29646670f14a.0000000000000093:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2691072~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:34.111 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T11:00:34.270 INFO:tasks.ceph.osd.1.smithi184.stderr:2024-09-17T11:00:34.265+0000 7f9d10566700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10599.0:1662 3.2 3:74d98f82:test1::rbd_data.29646670f14a.00000000000000f6:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1474560~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e164) 2024-09-17T11:00:34.409 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-09-17T11:00:34.411 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-09-17T11:00:34.420 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":5885,"stamp":"2024-09-17T11:00:33.682643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811212301,"num_objects":512,"num_object_clones":1,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":398,"num_whiteouts":169,"num_read":66156,"num_read_kb":137375,"num_write":18943,"num_write_kb":8818693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":769,"num_omap_keys":89,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27269,"ondisk_log_size":27269,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1292272,"kb_used_data":391896,"kb_used_omap":4,"kb_used_meta":900347,"kb_avail":281823248,"statfs":{"total":289910292480,"available":288587005952,"internally_reserved":0,"allocated":401301504,"data_stored":398740933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":921955336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003278"},"pg_stats":[{"pgid":"2.7","version":"166'794","reported_seq":1718,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T11:00:12.387481+0000","last_change":"2024-09-17T11:00:12.387444+0000","last_active":"2024-09-17T11:00:12.387481+0000","last_peered":"2024-09-17T11:00:12.387481+0000","last_clean":"2024-09-17T11:00:12.387481+0000","last_became_active":"2024-09-17T07:49:54.742525+0000","last_became_peered":"2024-09-17T07:49:54.742525+0000","last_unstale":"2024-09-17T11:00:12.387481+0000","last_undegraded":"2024-09-17T11:00:12.387481+0000","last_fullsized":"2024-09-17T11:00:12.387481+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'794","last_scrub_stamp":"2024-09-17T11:00:12.387340+0000","last_deep_scrub":"166'794","last_deep_scrub_stamp":"2024-09-17T11:00:12.387340+0000","last_clean_scrub_stamp":"2024-09-17T11:00:12.387340+0000","objects_scrubbed":9,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:01:12.400399+0000","scrub_duration":0.046416418000000001,"objects_trimmed":0,"snaptrim_duration":0.001454751,"stat_sum":{"num_bytes":17432677,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":1228,"num_write":634,"num_write_kb":1031948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"166'1075","reported_seq":2040,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T11:00:14.452260+0000","last_change":"2024-09-17T11:00:14.452205+0000","last_active":"2024-09-17T11:00:14.452260+0000","last_peered":"2024-09-17T11:00:14.452260+0000","last_clean":"2024-09-17T11:00:14.452260+0000","last_became_active":"2024-09-17T07:49:54.742569+0000","last_became_peered":"2024-09-17T07:49:54.742569+0000","last_unstale":"2024-09-17T11:00:14.452260+0000","last_undegraded":"2024-09-17T11:00:14.452260+0000","last_fullsized":"2024-09-17T11:00:14.452260+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1075","last_scrub_stamp":"2024-09-17T11:00:14.452087+0000","last_deep_scrub":"166'1075","last_deep_scrub_stamp":"2024-09-17T11:00:14.452087+0000","last_clean_scrub_stamp":"2024-09-17T11:00:14.452087+0000","objects_scrubbed":42,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:38.659357+0000","scrub_duration":0.13791869700000001,"objects_trimmed":0,"snaptrim_duration":0.0015246560000000001,"stat_sum":{"num_bytes":100733095,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":681,"num_read_kb":1354,"num_write":868,"num_write_kb":1140855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"166'874","reported_seq":1710,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T11:00:07.538353+0000","last_change":"2024-09-17T11:00:07.538292+0000","last_active":"2024-09-17T11:00:07.538353+0000","last_peered":"2024-09-17T11:00:07.538353+0000","last_clean":"2024-09-17T11:00:07.538353+0000","last_became_active":"2024-09-17T07:49:54.742621+0000","last_became_peered":"2024-09-17T07:49:54.742621+0000","last_unstale":"2024-09-17T11:00:07.538353+0000","last_undegraded":"2024-09-17T11:00:07.538353+0000","last_fullsized":"2024-09-17T11:00:07.538353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'874","last_scrub_stamp":"2024-09-17T11:00:07.538087+0000","last_deep_scrub":"166'874","last_deep_scrub_stamp":"2024-09-17T11:00:07.538087+0000","last_clean_scrub_stamp":"2024-09-17T11:00:07.538087+0000","objects_scrubbed":35,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:27.467642+0000","scrub_duration":0.17201174699999999,"objects_trimmed":0,"snaptrim_duration":0.00074955099999999999,"stat_sum":{"num_bytes":94798110,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":489,"num_read_kb":848,"num_write":719,"num_write_kb":1013068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"166'1032","reported_seq":1934,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:49.591683+0000","last_change":"2024-09-17T10:59:49.591620+0000","last_active":"2024-09-17T10:59:49.591683+0000","last_peered":"2024-09-17T10:59:49.591683+0000","last_clean":"2024-09-17T10:59:49.591683+0000","last_became_active":"2024-09-17T07:49:54.742709+0000","last_became_peered":"2024-09-17T07:49:54.742709+0000","last_unstale":"2024-09-17T10:59:49.591683+0000","last_undegraded":"2024-09-17T10:59:49.591683+0000","last_fullsized":"2024-09-17T10:59:49.591683+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1032","last_scrub_stamp":"2024-09-17T10:59:49.591436+0000","last_deep_scrub":"166'1032","last_deep_scrub_stamp":"2024-09-17T10:59:49.591436+0000","last_clean_scrub_stamp":"2024-09-17T10:59:49.591436+0000","objects_scrubbed":44,"log_size":1032,"log_dups_size":0,"ondisk_log_size":1032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:56:25.666993+0000","scrub_duration":0.14220772700000001,"objects_trimmed":0,"snaptrim_duration":0.00095990699999999997,"stat_sum":{"num_bytes":116007090,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":613,"num_read_kb":2297,"num_write":859,"num_write_kb":1136993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"166'4381","reported_seq":11452,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:31.990869+0000","last_change":"2024-09-17T10:59:31.990784+0000","last_active":"2024-09-17T10:59:31.990869+0000","last_peered":"2024-09-17T10:59:31.990869+0000","last_clean":"2024-09-17T10:59:31.990869+0000","last_became_active":"2024-09-17T07:50:02.527781+0000","last_became_peered":"2024-09-17T07:50:02.527781+0000","last_unstale":"2024-09-17T10:59:31.990869+0000","last_undegraded":"2024-09-17T10:59:31.990869+0000","last_fullsized":"2024-09-17T10:59:31.990869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'4381","last_scrub_stamp":"2024-09-17T10:59:31.990625+0000","last_deep_scrub":"166'4381","last_deep_scrub_stamp":"2024-09-17T10:59:31.990625+0000","last_clean_scrub_stamp":"2024-09-17T10:59:31.990625+0000","objects_scrubbed":70,"log_size":4381,"log_dups_size":0,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:30:19.076028+0000","scrub_duration":0.23644815199999999,"objects_trimmed":0,"snaptrim_duration":0.00075676900000000002,"stat_sum":{"num_bytes":54974462,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":47,"num_read":12857,"num_read_kb":28157,"num_write":2914,"num_write_kb":1864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2046,"num_flush":200,"num_flush_kb":6484,"num_evict":526,"num_evict_kb":51279,"num_promote":587,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"166'1035","reported_seq":2164,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:44.946247+0000","last_change":"2024-09-17T10:59:44.946161+0000","last_active":"2024-09-17T10:59:44.946247+0000","last_peered":"2024-09-17T10:59:44.946247+0000","last_clean":"2024-09-17T10:59:44.946247+0000","last_became_active":"2024-09-17T07:49:54.741869+0000","last_became_peered":"2024-09-17T07:49:54.741869+0000","last_unstale":"2024-09-17T10:59:44.946247+0000","last_undegraded":"2024-09-17T10:59:44.946247+0000","last_fullsized":"2024-09-17T10:59:44.946247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1035","last_scrub_stamp":"2024-09-17T10:59:44.946032+0000","last_deep_scrub":"166'1035","last_deep_scrub_stamp":"2024-09-17T10:59:44.946032+0000","last_clean_scrub_stamp":"2024-09-17T10:59:44.946032+0000","objects_scrubbed":49,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:10:04.840746+0000","scrub_duration":0.157516354,"objects_trimmed":0,"snaptrim_duration":0.00070501400000000001,"stat_sum":{"num_bytes":116101444,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":736,"num_read_kb":3147,"num_write":825,"num_write_kb":1144428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"166'6318","reported_seq":13346,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T11:00:26.447243+0000","last_change":"2024-09-17T11:00:26.447215+0000","last_active":"2024-09-17T11:00:26.447243+0000","last_peered":"2024-09-17T11:00:26.447243+0000","last_clean":"2024-09-17T11:00:26.447243+0000","last_became_active":"2024-09-17T07:50:02.527546+0000","last_became_peered":"2024-09-17T07:50:02.527546+0000","last_unstale":"2024-09-17T11:00:26.447243+0000","last_undegraded":"2024-09-17T11:00:26.447243+0000","last_fullsized":"2024-09-17T11:00:26.447243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'6318","last_scrub_stamp":"2024-09-17T11:00:26.447117+0000","last_deep_scrub":"166'6318","last_deep_scrub_stamp":"2024-09-17T11:00:26.447117+0000","last_clean_scrub_stamp":"2024-09-17T11:00:26.447117+0000","objects_scrubbed":56,"log_size":6318,"log_dups_size":0,"ondisk_log_size":6318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:34.514012+0000","scrub_duration":0.208879916,"objects_trimmed":0,"snaptrim_duration":0.0058704869999999998,"stat_sum":{"num_bytes":23536909,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":43,"num_read":20517,"num_read_kb":27897,"num_write":5054,"num_write_kb":3695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1293,"num_flush":231,"num_flush_kb":1996,"num_evict":571,"num_evict_kb":8197,"num_promote":621,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"166'983","reported_seq":1925,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:07.860364+0000","last_change":"2024-09-17T10:57:07.860324+0000","last_active":"2024-09-17T10:57:07.860364+0000","last_peered":"2024-09-17T10:57:07.860364+0000","last_clean":"2024-09-17T10:57:07.860364+0000","last_became_active":"2024-09-17T07:49:54.741779+0000","last_became_peered":"2024-09-17T07:49:54.741779+0000","last_unstale":"2024-09-17T10:57:07.860364+0000","last_undegraded":"2024-09-17T10:57:07.860364+0000","last_fullsized":"2024-09-17T10:57:07.860364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'983","last_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_deep_scrub":"166'983","last_deep_scrub_stamp":"2024-09-17T10:57:07.860011+0000","last_clean_scrub_stamp":"2024-09-17T10:57:07.860011+0000","objects_scrubbed":31,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:59.558371+0000","scrub_duration":0.108377354,"objects_trimmed":0,"snaptrim_duration":0.00039288799999999998,"stat_sum":{"num_bytes":86450327,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":658,"num_read_kb":7442,"num_write":814,"num_write_kb":1059117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"166'3537","reported_seq":8936,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:49.927507+0000","last_change":"2024-09-17T10:59:49.927441+0000","last_active":"2024-09-17T10:59:49.927507+0000","last_peered":"2024-09-17T10:59:49.927507+0000","last_clean":"2024-09-17T10:59:49.927507+0000","last_became_active":"2024-09-17T07:50:02.527428+0000","last_became_peered":"2024-09-17T07:50:02.527428+0000","last_unstale":"2024-09-17T10:59:49.927507+0000","last_undegraded":"2024-09-17T10:59:49.927507+0000","last_fullsized":"2024-09-17T10:59:49.927507+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'3537","last_scrub_stamp":"2024-09-17T10:59:49.927269+0000","last_deep_scrub":"166'3537","last_deep_scrub_stamp":"2024-09-17T10:59:49.927269+0000","last_clean_scrub_stamp":"2024-09-17T10:59:49.927269+0000","objects_scrubbed":52,"log_size":3537,"log_dups_size":0,"ondisk_log_size":3537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:34.343521+0000","scrub_duration":0.12179612099999999,"objects_trimmed":0,"snaptrim_duration":0.00059629099999999999,"stat_sum":{"num_bytes":7316295,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":45,"num_read":13939,"num_read_kb":34118,"num_write":2338,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":741,"num_flush":177,"num_flush_kb":1092,"num_evict":542,"num_evict_kb":32042,"num_promote":591,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"166'1495","reported_seq":2503,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:57:13.984647+0000","last_change":"2024-09-17T10:57:13.984587+0000","last_active":"2024-09-17T10:57:13.984647+0000","last_peered":"2024-09-17T10:57:13.984647+0000","last_clean":"2024-09-17T10:57:13.984647+0000","last_became_active":"2024-09-17T07:49:54.739270+0000","last_became_peered":"2024-09-17T07:49:54.739270+0000","last_unstale":"2024-09-17T10:57:13.984647+0000","last_undegraded":"2024-09-17T10:57:13.984647+0000","last_fullsized":"2024-09-17T10:57:13.984647+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1495","last_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_deep_scrub":"166'1495","last_deep_scrub_stamp":"2024-09-17T10:57:13.984462+0000","last_clean_scrub_stamp":"2024-09-17T10:57:13.984462+0000","objects_scrubbed":41,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:00.459873+0000","scrub_duration":0.18888802800000001,"objects_trimmed":0,"snaptrim_duration":0.00031940000000000001,"stat_sum":{"num_bytes":109518949,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":770,"num_read_kb":3320,"num_write":879,"num_write_kb":1163084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"166'4333","reported_seq":11132,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T11:00:22.459853+0000","last_change":"2024-09-17T11:00:22.459751+0000","last_active":"2024-09-17T11:00:22.459853+0000","last_peered":"2024-09-17T11:00:22.459853+0000","last_clean":"2024-09-17T11:00:22.459853+0000","last_became_active":"2024-09-17T07:50:02.527479+0000","last_became_peered":"2024-09-17T07:50:02.527479+0000","last_unstale":"2024-09-17T11:00:22.459853+0000","last_undegraded":"2024-09-17T11:00:22.459853+0000","last_fullsized":"2024-09-17T11:00:22.459853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'4333","last_scrub_stamp":"2024-09-17T11:00:22.459510+0000","last_deep_scrub":"166'4333","last_deep_scrub_stamp":"2024-09-17T11:00:22.459510+0000","last_clean_scrub_stamp":"2024-09-17T11:00:22.459510+0000","objects_scrubbed":53,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:45:58.311972+0000","scrub_duration":0.2093932,"objects_trimmed":0,"snaptrim_duration":0.0011601770000000001,"stat_sum":{"num_bytes":49939683,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":33,"num_read":13507,"num_read_kb":25048,"num_write":2216,"num_write_kb":1249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1235,"num_flush":186,"num_flush_kb":4710,"num_evict":716,"num_evict_kb":27100,"num_promote":764,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"166'1358","reported_seq":2370,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T11:00:15.389931+0000","last_change":"2024-09-17T11:00:15.389894+0000","last_active":"2024-09-17T11:00:15.389931+0000","last_peered":"2024-09-17T11:00:15.389931+0000","last_clean":"2024-09-17T11:00:15.389931+0000","last_became_active":"2024-09-17T07:49:54.737025+0000","last_became_peered":"2024-09-17T07:49:54.737025+0000","last_unstale":"2024-09-17T11:00:15.389931+0000","last_undegraded":"2024-09-17T11:00:15.389931+0000","last_fullsized":"2024-09-17T11:00:15.389931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'1358","last_scrub_stamp":"2024-09-17T11:00:15.389720+0000","last_deep_scrub":"166'1358","last_deep_scrub_stamp":"2024-09-17T11:00:15.389720+0000","last_clean_scrub_stamp":"2024-09-17T11:00:15.389720+0000","objects_scrubbed":28,"log_size":1358,"log_dups_size":0,"ondisk_log_size":1358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:06:01.878663+0000","scrub_duration":0.09106612,"objects_trimmed":0,"snaptrim_duration":0.001188286,"stat_sum":{"num_bytes":33812892,"num_objects":28,"num_object_clones":1,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":1,"num_read":735,"num_read_kb":2473,"num_write":744,"num_write_kb":1120182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":174,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"166'54","reported_seq":242,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T10:59:45.503060+0000","last_change":"2024-09-17T10:59:45.502997+0000","last_active":"2024-09-17T10:59:45.503060+0000","last_peered":"2024-09-17T10:59:45.503060+0000","last_clean":"2024-09-17T10:59:45.503060+0000","last_became_active":"2024-09-17T07:49:50.351335+0000","last_became_peered":"2024-09-17T07:49:50.351335+0000","last_unstale":"2024-09-17T10:59:45.503060+0000","last_undegraded":"2024-09-17T10:59:45.503060+0000","last_fullsized":"2024-09-17T10:59:45.503060+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'54","last_scrub_stamp":"2024-09-17T10:59:45.502750+0000","last_deep_scrub":"166'54","last_deep_scrub_stamp":"2024-09-17T10:59:45.502750+0000","last_clean_scrub_stamp":"2024-09-17T10:59:45.502750+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:04:16.115005+0000","scrub_duration":0.010341426000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":135767349,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":117,"num_whiteouts":168,"num_read":60820,"num_read_kb":115220,"num_write":12522,"num_write_kb":7912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":29,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5315,"num_flush":794,"num_flush_kb":14282,"num_evict":2355,"num_evict_kb":118618,"num_promote":2563,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137961472,"data_stored":137783914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18569,"ondisk_log_size":18569,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":674854584,"num_objects":279,"num_object_clones":1,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":1,"num_read":5280,"num_read_kb":22109,"num_write":6342,"num_write_kb":8809675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":77,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257990656,"data_stored":257650032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8646,"ondisk_log_size":8646,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740661,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":424744,"kb_used_data":123232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93947096,"statfs":{"total":96636764160,"available":96201826304,"internally_reserved":0,"allocated":126189568,"data_stored":125356377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.443,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.60599999999999998,"5min":0.72399999999999998,"15min":0.72999999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.51400000000000001,"5min":0.47799999999999998,"15min":0.46300000000000002},"max":{"1min":0.69699999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Tue Sep 17 10:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.59399999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.90800000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69499999999999995,"15min":0.69399999999999995},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.47399999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"last":0.80500000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740666,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":465796,"kb_used_data":164284,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":93906044,"statfs":{"total":96636764160,"available":96159789056,"internally_reserved":0,"allocated":168226816,"data_stored":167326804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 10:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.61199999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.647},"last":0.75700000000000001}]},{"osd":2,"last update":"Tue Sep 17 10:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.68400000000000005,"5min":0.76800000000000002,"15min":0.83399999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.62,"15min":0.627},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.75700000000000001,"5min":0.80800000000000005,"15min":0.90700000000000003},"last":0.79700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740668,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401732,"kb_used_data":104380,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93970108,"statfs":{"total":96636764160,"available":96225390592,"internally_reserved":0,"allocated":106885120,"data_stored":106057752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 10:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52000000000000002,"15min":0.52800000000000002},"min":{"1min":0.40400000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.73499999999999999,"15min":0.78300000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.054},"last":0.75800000000000001}]},{"osd":2,"last update":"Tue Sep 17 10:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.42199999999999999},"max":{"1min":0.73199999999999998,"5min":0.80600000000000005,"15min":1.0389999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.82599999999999996,"5min":1.012,"15min":1.012},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73175040,"data_stored":73069600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128995328,"data_stored":128825016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55820288,"data_stored":55755416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31731712,"data_stored":31689541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37249024,"data_stored":37202416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68980736,"data_stored":68891957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T11:00:34.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T11:00:34.730 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T11:00:34.731 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T11:00:34.731 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T11:00:34.731 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T11:00:34.804 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T11:00:34.804 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T11:00:34.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T11:00:34.881 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T11:00:34.882 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T11:00:34.882 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T11:00:34.957 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T11:00:34.957 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T11:00:34.957 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T11:00:34.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T11:00:34.987 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T11:00:34.987 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T11:00:34.987 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T11:00:34.988 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T11:00:35.014 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T11:00:35.015 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T11:00:35.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2024-09-17T11:00:35.029 INFO:teuthology.orchestra.run.smithi184.stdout:1726559798.2788794 osd.0 (osd.0) 3 : cluster [WRN] 256 slow requests (by type [ 'reached pg' : 256 ] most affected pool [ 'cache' : 256 ]) 2024-09-17T11:00:35.032 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-09-17T11:00:35.032 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T11:00:35.032 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T11:00:35.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T11:00:35.471 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T11:00:35.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T11:00:35.679 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T11:00:35.855 INFO:tasks.ceph:Archiving mon data... 2024-09-17T11:00:35.856 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7908726/data/mon.a.tgz 2024-09-17T11:00:35.857 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-09-17T11:00:35.861 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.WlVs7h7Ymg 2024-09-17T11:00:35.862 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WlVs7h7Ymg 2024-09-17T11:00:36.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.WlVs7h7Ymg 2024-09-17T11:00:36.023 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.WlVs7h7Ymg is 433KB 2024-09-17T11:00:36.085 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.WlVs7h7Ymg 2024-09-17T11:00:36.091 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T11:00:36.092 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T11:00:36.106 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-17T11:00:36.106 DEBUG:teuthology.orchestra.run.smithi184:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-17T11:00:36.129 INFO:teuthology.orchestra.run.smithi184.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-17T11:00:36.135 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T11:00:36.137 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7908726/remote/smithi184/crash 2024-09-17T11:00:36.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T11:00:36.194 INFO:tasks.ceph:Compressing logs... 2024-09-17T11:00:36.194 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T11:00:36.212 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-09-17T11:00:36.213 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62153.log 2024-09-17T11:00:36.213 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29440.log 2024-09-17T11:00:36.215 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31870.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-09-17T11:00:36.215 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46118.log 2024-09-17T11:00:36.215 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62153.log.gz 2024-09-17T11:00:36.216 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35749.log 2024-09-17T11:00:36.216 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29504.log 2024-09-17T11:00:36.216 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29440.log.gz 2024-09-17T11:00:36.216 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46118.log.gz 2024-09-17T11:00:36.216 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35749.log.gz 2024-09-17T11:00:36.216 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2024-09-17T11:00:36.218 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 2024-09-17T11:00:36.218 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29504.log: 0.0%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.29504.log.gz-- 2024-09-17T11:00:36.218 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49232.log 2024-09-17T11:00:36.218 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz 2024-09-17T11:00:36.219 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27128.log 2024-09-17T11:00:36.219 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2024-09-17T11:00:36.219 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49232.log.gz 2024-09-17T11:00:36.219 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60710.log 2024-09-17T11:00:36.219 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27128.log.gz 2024-09-17T11:00:36.221 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47524.log 2024-09-17T11:00:36.221 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28133.log 2024-09-17T11:00:36.221 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60710.log.gz 2024-09-17T11:00:36.221 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44610.log 2024-09-17T11:00:36.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47524.log.gz 2024-09-17T11:00:36.222 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32114.log 2024-09-17T11:00:36.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28133.log.gz 2024-09-17T11:00:36.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44610.log.gz 2024-09-17T11:00:36.222 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45860.log 2024-09-17T11:00:36.222 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51069.log 2024-09-17T11:00:36.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32114.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32114.log.gz 2024-09-17T11:00:36.225 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-09-17T11:00:36.225 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45860.log.gz 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51069.log.gz 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66422.log 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38477.log 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42265.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61292.log 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66422.log.gz 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63039.log 2024-09-17T11:00:36.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38477.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38477.log.gz 2024-09-17T11:00:36.227 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61292.log.gz 2024-09-17T11:00:36.227 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34269.log 2024-09-17T11:00:36.227 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63039.log.gz 2024-09-17T11:00:36.227 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26070.log 2024-09-17T11:00:36.230 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34269.log.gz 2024-09-17T11:00:36.230 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62744.log 2024-09-17T11:00:36.230 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55299.log /var/log/ceph/ceph-client.admin.26070.log: 2024-09-17T11:00:36.230 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26070.log.gz 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39297.log 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62744.log.gz 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67439.log 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55299.log.gz 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28367.log 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39297.log.gz 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67439.log.gz 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26763.log 2024-09-17T11:00:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67884.log 2024-09-17T11:00:36.232 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28367.log.gz 2024-09-17T11:00:36.232 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60361.log 2024-09-17T11:00:36.232 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26763.log.gz 2024-09-17T11:00:36.232 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67884.log.gz 2024-09-17T11:00:36.232 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28453.log 2024-09-17T11:00:36.239 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60361.log: /var/log/ceph/ceph-client.admin.47331.log 2024-09-17T11:00:36.239 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60361.log.gz 2024-09-17T11:00:36.239 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2024-09-17T11:00:36.239 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28453.log.gz 2024-09-17T11:00:36.239 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35149.log 2024-09-17T11:00:36.239 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52905.log 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60669.log 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35149.log.gz 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34069.log 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52905.log.gz 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60669.log.gz 2024-09-17T11:00:36.240 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60844.log 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34069.log.gz 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69698.log 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55852.log 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60844.log.gz 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69698.log.gz 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32982.log 2024-09-17T11:00:36.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55852.log.gz 2024-09-17T11:00:36.242 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45452.log 2024-09-17T11:00:36.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2024-09-17T11:00:36.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52029.log 2024-09-17T11:00:36.242 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32982.log.gz 2024-09-17T11:00:36.242 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2024-09-17T11:00:36.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45452.log.gz 2024-09-17T11:00:36.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52029.log.gz 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52397.log 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49254.log 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44932.log 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52397.log.gz 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57768.log 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49254.log.gz 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53155.log 2024-09-17T11:00:36.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44932.log.gz 2024-09-17T11:00:36.250 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67292.log 2024-09-17T11:00:36.250 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57768.log.gz 2024-09-17T11:00:36.250 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32233.log 2024-09-17T11:00:36.250 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53155.log: /var/log/ceph/ceph-client.admin.67292.log: gzip 0.0%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53155.log.gz/var/log/ceph/ceph-client.admin.63416.log 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67292.log.gz 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46231.log 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32233.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32233.log.gz 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63416.log.gz 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57848.log 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46231.log.gz 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-09-17T11:00:36.251 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-09-17T11:00:36.252 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57848.log.gz 2024-09-17T11:00:36.252 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35963.log 2024-09-17T11:00:36.252 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43224.log: /var/log/ceph/ceph-client.admin.42160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gzgzip 2024-09-17T11:00:36.252 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.33237.log 2024-09-17T11:00:36.252 INFO:teuthology.orchestra.run.smithi184.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-09-17T11:00:36.252 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27374.log 2024-09-17T11:00:36.252 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35963.log.gz 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49986.log 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33237.log: /var/log/ceph/ceph-client.admin.27374.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33237.log.gz 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27374.log.gz 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36371.log 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36116.log 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49986.log: /var/log/ceph/ceph-client.admin.36371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49986.log.gz 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36371.log.gz 2024-09-17T11:00:36.253 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21021.log 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36116.log.gz 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42770.log 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.21021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34369.log 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21021.log.gz 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30729.log 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42770.log.gz 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63240.log 2024-09-17T11:00:36.254 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34369.log.gz 2024-09-17T11:00:36.255 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2024-09-17T11:00:36.255 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30729.log.gz 2024-09-17T11:00:36.255 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63240.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.63240.log.gz--verbose 2024-09-17T11:00:36.255 INFO:teuthology.orchestra.run.smithi184.stderr:-- /var/log/ceph/ceph-client.admin.44889.log 2024-09-17T11:00:36.255 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2024-09-17T11:00:36.255 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48595.log 2024-09-17T11:00:36.255 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69440.log 2024-09-17T11:00:36.256 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44889.log.gz 2024-09-17T11:00:36.256 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48595.log.gz 2024-09-17T11:00:36.275 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36065.log 2024-09-17T11:00:36.275 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69440.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.53911.log 2024-09-17T11:00:36.275 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69440.log.gz 2024-09-17T11:00:36.275 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43887.log 2024-09-17T11:00:36.275 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36065.log.gz 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41840.log 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53911.log.gz 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55111.log 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27875.log 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43887.log.gz 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41840.log: /var/log/ceph/ceph-client.admin.55111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41840.log.gz 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58385.log 2024-09-17T11:00:36.276 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55111.log.gz 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56260.log 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27875.log.gz 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62212.log 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58385.log: /var/log/ceph/ceph-client.admin.56260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58385.log.gz 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45581.log 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56260.log.gz 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58529.log 2024-09-17T11:00:36.277 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56239.log 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0%/var/log/ceph/ceph-client.admin.45581.log: -- replaced with /var/log/ceph/ceph-client.admin.62212.log.gz 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45581.log.gz 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46054.log 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58529.log.gz 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48101.log 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56239.log.gz 2024-09-17T11:00:36.278 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46054.log.gz 2024-09-17T11:00:36.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-09-17T11:00:36.279 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48433.log 2024-09-17T11:00:36.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60244.log 2024-09-17T11:00:36.279 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48101.log.gz 2024-09-17T11:00:36.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63866.log 2024-09-17T11:00:36.279 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48433.log.gz 2024-09-17T11:00:36.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63220.log 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60244.log.gz 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62550.log 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63866.log.gz 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35529.log 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63220.log.gz 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28711.log 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62550.log.gz 2024-09-17T11:00:36.280 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56540.log 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35529.log.gz 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52885.log 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28711.log: gzip /var/log/ceph/ceph-client.admin.56540.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56540.log.gz 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28711.log.gz 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63511.log 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52885.log.gz 2024-09-17T11:00:36.281 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65500.log 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.63511.log.gz 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42706.log 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65500.log.gz 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-09-17T11:00:36.282 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68523.log 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42706.log.gz 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29547.log 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57304.log 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68523.log.gz 2024-09-17T11:00:36.283 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2024-09-17T11:00:36.284 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61467.log 2024-09-17T11:00:36.284 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29547.log.gz 2024-09-17T11:00:36.284 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50093.log 2024-09-17T11:00:36.284 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57304.log.gz 2024-09-17T11:00:36.284 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41549.log 2024-09-17T11:00:36.284 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61467.log: gzip /var/log/ceph/ceph-client.admin.50093.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65798.log 2024-09-17T11:00:36.284 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61467.log.gz 2024-09-17T11:00:36.285 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50093.log.gz 2024-09-17T11:00:36.285 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41640.log 2024-09-17T11:00:36.285 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41549.log: /var/log/ceph/ceph-client.admin.65798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41549.log.gz 2024-09-17T11:00:36.285 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2024-09-17T11:00:36.285 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65798.log.gz 2024-09-17T11:00:36.285 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43787.log 2024-09-17T11:00:36.285 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41640.log.gz 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34609.log 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26390.log /var/log/ceph/ceph-client.admin.43787.log: 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43787.log.gz 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43829.log 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34609.log: /var/log/ceph/ceph-client.admin.26390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34609.log.gz 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50918.log 2024-09-17T11:00:36.286 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26390.log.gz 2024-09-17T11:00:36.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61997.log 2024-09-17T11:00:36.287 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43829.log.gz 2024-09-17T11:00:36.287 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61309.log 2024-09-17T11:00:36.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50918.log.gz 2024-09-17T11:00:36.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49340.log 2024-09-17T11:00:36.287 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61997.log.gz 2024-09-17T11:00:36.287 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27477.log 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61309.log.gz 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59191.log 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49340.log.gz 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40656.log 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27477.log.gz 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59191.log: /var/log/ceph/ceph-client.admin.58323.log 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59191.log.gz 2024-09-17T11:00:36.288 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69247.log 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35827.log 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr: 29.2% -- replaced with /var/log/ceph/ceph-client.admin.40656.log.gz 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58323.log.gz 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31376.log 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69247.log.gz 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35827.log.gz 2024-09-17T11:00:36.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2024-09-17T11:00:36.290 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31376.log.gz 2024-09-17T11:00:36.290 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59793.log 2024-09-17T11:00:36.290 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-09-17T11:00:36.290 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29998.log 2024-09-17T11:00:36.290 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2024-09-17T11:00:36.290 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61326.log 2024-09-17T11:00:36.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59793.log.gz 2024-09-17T11:00:36.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53482.log 2024-09-17T11:00:36.291 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29998.log.gz 2024-09-17T11:00:36.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52115.log 2024-09-17T11:00:36.291 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61326.log.gz 2024-09-17T11:00:36.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27021.log 2024-09-17T11:00:36.291 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.53482.log.gz 2024-09-17T11:00:36.292 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36949.log 2024-09-17T11:00:36.292 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52115.log.gz 2024-09-17T11:00:36.292 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49470.log 2024-09-17T11:00:36.910 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27021.log.gz 2024-09-17T11:00:36.910 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36949.log.gz 2024-09-17T11:00:36.910 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29612.log 2024-09-17T11:00:36.910 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52990.log 2024-09-17T11:00:36.911 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49470.log.gz 2024-09-17T11:00:36.911 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35729.log 2024-09-17T11:00:36.911 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29612.log.gz 2024-09-17T11:00:36.911 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54407.log 2024-09-17T11:00:36.911 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52990.log.gz 2024-09-17T11:00:36.911 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66443.log 2024-09-17T11:00:36.911 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35729.log.gz 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39698.log 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54407.log.gz 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46759.log 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66443.log.gz 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64452.log 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39698.log.gz 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37763.log 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46759.log.gz 2024-09-17T11:00:36.912 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31210.log 2024-09-17T11:00:36.913 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64452.log.gz 2024-09-17T11:00:36.913 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41506.log 2024-09-17T11:00:36.913 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37763.log.gz 2024-09-17T11:00:36.913 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.31210.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-09-17T11:00:36.913 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31210.log.gz 2024-09-17T11:00:36.913 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62649.log 2024-09-17T11:00:36.913 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41506.log.gz 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29332.log 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51879.log 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62649.log: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.62649.log.gz 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56580.log 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29332.log.gz 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46406.log 2024-09-17T11:00:36.914 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51879.log.gz 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64323.log 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56580.log.gz 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56558.log 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46406.log.gz 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51599.log 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64323.log.gz 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54126.log 2024-09-17T11:00:36.915 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56558.log.gz 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31827.log 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51599.log.gz 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47998.log 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54126.log.gz 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58489.log 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31827.log.gz 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26784.log 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2024-09-17T11:00:36.916 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58489.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.62630.log 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58489.log.gz 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44975.log 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26784.log.gz 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62630.log.gz 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.44975.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44975.log.gz 2024-09-17T11:00:36.917 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31333.log: 0.0%/var/log/ceph/ceph-client.admin.46794.log: -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26849.log 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61901.log 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26849.log.gz 2024-09-17T11:00:36.918 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.51473.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51707.log 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr: 55.6% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gz 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28260.log 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61901.log.gz 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52781.log 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51707.log.gz 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63139.log 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28260.log.gz 2024-09-17T11:00:36.919 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52781.log.gz 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63139.log.gz 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36456.log 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32041.log 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2024-09-17T11:00:36.920 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56659.log 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36456.log.gz 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65691.log 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32041.log.gz 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37119.log 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.56659.log.gz 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65691.log: /var/log/ceph/ceph-client.admin.42542.log 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65691.log.gz 2024-09-17T11:00:36.921 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61343.log 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37119.log.gz 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28195.log 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54191.log 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61343.log.gz 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56382.log 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28195.log.gz 2024-09-17T11:00:36.922 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39318.log 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54191.log.gz 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29783.log 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56382.log.gz 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46370.log 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39318.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39318.log.gz 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.29783.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57909.log 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29783.log.gz 2024-09-17T11:00:36.923 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60863.log 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46370.log.gz 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66228.log 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57909.log.gz 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53954.log 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60863.log: 56.2% -- replaced with /var/log/ceph/ceph-client.admin.60863.log.gz 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65607.log 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66228.log.gz 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49878.log 2024-09-17T11:00:36.924 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53954.log.gz 2024-09-17T11:00:36.925 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51771.log 2024-09-17T11:00:36.925 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65607.log.gz 2024-09-17T11:00:36.925 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2024-09-17T11:00:36.925 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49878.log.gz 2024-09-17T11:00:36.925 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32693.log 2024-09-17T11:00:36.925 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51771.log.gz 2024-09-17T11:00:36.925 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61942.log 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32693.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32693.log.gz 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27969.log 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61942.log.gz 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65841.log 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2024-09-17T11:00:36.926 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67902.log 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27969.log.gz 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25917.log 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65841.log.gz 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58804.log 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.67902.log.gz 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49017.log 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25917.log.gz 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61564.log 2024-09-17T11:00:36.927 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58804.log.gz 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37153.log 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49017.log: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.49017.log.gz 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55008.log 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61564.log.gz 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36915.log 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37153.log.gz 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58085.log 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55008.log.gz 2024-09-17T11:00:36.928 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27298.log 2024-09-17T11:00:36.929 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36915.log.gz 2024-09-17T11:00:36.929 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-09-17T11:00:36.929 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58085.log.gz 2024-09-17T11:00:36.929 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39848.log 2024-09-17T11:00:36.929 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27298.log.gz 2024-09-17T11:00:36.929 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36592.log 2024-09-17T11:00:36.929 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39848.log.gz 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48911.log 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36592.log.gz 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56442.log 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60201.log 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48911.log.gz 2024-09-17T11:00:36.930 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67002.log 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56442.log.gz 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60201.log.gz 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36796.log 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67002.log.gz 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28091.log 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67765.log 2024-09-17T11:00:36.931 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-09-17T11:00:36.932 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36796.log.gz 2024-09-17T11:00:36.932 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31483.log 2024-09-17T11:00:36.932 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28091.log.gz 2024-09-17T11:00:36.932 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56420.log 2024-09-17T11:00:36.932 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67765.log.gz 2024-09-17T11:00:36.932 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47978.log 2024-09-17T11:00:36.932 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31483.log.gz 2024-09-17T11:00:36.933 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57476.log 2024-09-17T11:00:36.933 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56420.log.gz 2024-09-17T11:00:36.933 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27432.log 2024-09-17T11:00:36.933 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47978.log.gz 2024-09-17T11:00:36.933 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56480.log 2024-09-17T11:00:36.933 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57476.log.gz 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68927.log 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27432.log.gz 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51453.log 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56480.log.gz 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28947.log 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68927.log.gz 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46265.log 2024-09-17T11:00:36.934 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51453.log.gz 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40990.log 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.28947.log.gz 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33356.log 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27781.log 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46265.log.gz 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40990.log: /var/log/ceph/ceph-client.admin.33356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34769.log 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40990.log.gz 2024-09-17T11:00:36.935 INFO:teuthology.orchestra.run.smithi184.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33356.log.gz 2024-09-17T11:00:36.936 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30985.log 2024-09-17T11:00:36.936 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27781.log.gz 2024-09-17T11:00:36.936 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34769.log.gz 2024-09-17T11:00:36.936 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54321.log 2024-09-17T11:00:36.936 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21056.log 2024-09-17T11:00:36.936 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30985.log.gz 2024-09-17T11:00:36.936 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30406.log 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54321.log.gz 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32284.log 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.21056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21056.log.gz 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37784.log 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30406.log.gz 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44911.log 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32284.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32284.log.gz 2024-09-17T11:00:36.937 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59363.log 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr: 23.1% -- replaced with /var/log/ceph/ceph-client.admin.37784.log.gz 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57240.log 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38036.log 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44911.log.gz 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59363.log: /var/log/ceph/ceph-client.admin.57240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27837.log 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57240.log.gz 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59363.log.gz 2024-09-17T11:00:36.938 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32999.log 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38036.log: 23.1% -- replaced with /var/log/ceph/ceph-client.admin.38036.log.gz 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34549.log 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27837.log.gz 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66250.log 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32999.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32999.log.gz 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30514.log 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34549.log.gz 2024-09-17T11:00:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.66250.log: -- /var/log/ceph/ceph-client.admin.69333.log 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66250.log.gz 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49513.log 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30514.log.gz 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57003.log 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69333.log.gz 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41334.log 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49513.log.gz 2024-09-17T11:00:36.940 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57003.log.gz 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41334.log.gz 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56153.log 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35109.log 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2024-09-17T11:00:36.941 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42444.log 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56153.log.gz 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40042.log 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35109.log.gz 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67626.log 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42444.log: 9.3% -- replaced with /var/log/ceph/ceph-client.admin.42444.log.gz 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58280.log 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40042.log.gz 2024-09-17T11:00:36.942 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67626.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.67626.log.gz 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38288.log 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58280.log.gz 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28389.log 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34629.log 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38288.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38288.log.gz 2024-09-17T11:00:36.943 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66486.log 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28389.log.gz 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41227.log 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34629.log.gz 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39444.log 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66486.log.gz 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41227.log.gz 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36082.log 2024-09-17T11:00:36.944 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39444.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.39444.log.gz 2024-09-17T11:00:36.945 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51493.log 2024-09-17T11:00:36.945 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38372.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gz 2024-09-17T11:00:36.945 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50746.log 2024-09-17T11:00:36.945 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36082.log.gz 2024-09-17T11:00:36.945 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31419.log 2024-09-17T11:00:36.945 INFO:teuthology.orchestra.run.smithi184.stderr: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.51493.log.gz 2024-09-17T11:00:36.945 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40600.log 2024-09-17T11:00:36.946 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50746.log.gz 2024-09-17T11:00:36.946 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47895.log 2024-09-17T11:00:36.946 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31419.log.gz 2024-09-17T11:00:36.946 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70799.log 2024-09-17T11:00:36.946 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40600.log.gz 2024-09-17T11:00:36.946 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32165.log 2024-09-17T11:00:36.946 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47895.log.gz 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39213.log 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70799.log.gz 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52946.log 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32165.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32165.log.gz 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53718.log 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39213.log.gz 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60439.log 2024-09-17T11:00:36.947 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52946.log.gz 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33849.log 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53718.log.gz 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26098.log 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60439.log.gz 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58592.log 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33849.log.gz 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50682.log 2024-09-17T11:00:36.948 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55486.log 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26098.log.gz 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58592.log.gz 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64302.log 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50682.log.gz 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29483.log 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55486.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.55486.log.gz 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59105.log 2024-09-17T11:00:36.949 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64302.log.gz 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37017.log 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29483.log.gz 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32914.log 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59105.log.gz 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28346.log 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37017.log.gz 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54450.log 2024-09-17T11:00:36.950 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32914.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32914.log.gz 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46879.log 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28346.log.gz 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54450.log.gz 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61486.log 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46879.log.gz 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50282.log 2024-09-17T11:00:36.951 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-09-17T11:00:36.952 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64388.log 2024-09-17T11:00:36.952 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62114.log 2024-09-17T11:00:36.952 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61486.log.gz 2024-09-17T11:00:36.952 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50282.log: gzip /var/log/ceph/ceph-client.admin.64388.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28604.log 2024-09-17T11:00:36.952 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50282.log.gz 2024-09-17T11:00:36.952 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64388.log.gz 2024-09-17T11:00:36.952 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62114.log.gz 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68201.log 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28604.log.gz 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38435.log 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.68201.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42792.log 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68201.log.gz 2024-09-17T11:00:36.953 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38435.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38435.log.gz 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42792.log.gz 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53868.log 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33067.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43969.log 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53358.log 2024-09-17T11:00:36.954 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53868.log.gz 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27192.log 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43969.log.gz 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66658.log 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53358.log.gz 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57891.log 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27192.log.gz 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31002.log 2024-09-17T11:00:36.955 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66658.log.gz 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30772.log 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57891.log.gz 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47417.log 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31002.log.gz 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36218.log 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30772.log.gz 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27553.log 2024-09-17T11:00:36.956 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47417.log.gz 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37553.log 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36218.log.gz 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32931.log 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27553.log.gz 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37553.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37553.log.gz 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60941.log 2024-09-17T11:00:36.957 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32931.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32931.log.gz 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38688.log 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43309.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gz 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38498.log 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60941.log.gz 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42585.log 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38688.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38688.log.gz 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38498.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.38498.log.gz 2024-09-17T11:00:36.958 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54751.log 2024-09-17T11:00:36.959 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42585.log.gz 2024-09-17T11:00:36.959 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45968.log 2024-09-17T11:00:36.959 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39276.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2024-09-17T11:00:36.959 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66056.log 2024-09-17T11:00:36.959 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54751.log.gz 2024-09-17T11:00:36.959 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41248.log 2024-09-17T11:00:36.959 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45968.log.gz 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47180.log 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66056.log.gz 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27723.log 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41248.log: 0.0%/var/log/ceph/ceph-client.admin.47180.log: -- replaced with /var/log/ceph/ceph-client.admin.41248.log.gz 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36031.log 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47180.log.gz 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65378.log 2024-09-17T11:00:36.960 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27723.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27723.log.gz 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33084.log 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36031.log.gz 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47438.log 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.65378.log.gz 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34449.log 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33084.log.gz 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31526.log 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47438.log.gz 2024-09-17T11:00:36.961 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67863.log 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34449.log.gz 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31526.log.gz 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56831.log 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67863.log: 57.8% -- replaced with /var/log/ceph/ceph-client.admin.67863.log.gz 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65949.log 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2024-09-17T11:00:36.962 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37595.log 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56831.log.gz 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27217.log 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65949.log.gz 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30363.log 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37595.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.37595.log.gz 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62784.log 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27217.log.gz 2024-09-17T11:00:36.963 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45147.log 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30363.log.gz 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33577.log 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62784.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.62784.log.gz 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41012.log 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45147.log.gz 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55025.log 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65318.log 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33577.log.gz 2024-09-17T11:00:36.964 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54536.log 2024-09-17T11:00:36.965 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41012.log.gz 2024-09-17T11:00:36.965 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55025.log.gz 2024-09-17T11:00:36.965 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63845.log 2024-09-17T11:00:36.965 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65318.log.gz 2024-09-17T11:00:36.965 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29526.log 2024-09-17T11:00:36.965 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54536.log.gz 2024-09-17T11:00:36.965 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66594.log 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63845.log.gz 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26371.log 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29526.log.gz 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54235.log 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66594.log.gz 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40149.log 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26371.log.gz 2024-09-17T11:00:36.966 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53782.log 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54235.log.gz 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48932.log 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40149.log.gz 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.53782.log: --verbose -- /var/log/ceph/ceph-client.admin.47266.log 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.53782.log.gz 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32455.log 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48932.log.gz 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29375.log 2024-09-17T11:00:36.967 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47266.log.gz 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47654.log 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32455.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32455.log.gz 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65927.log 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29375.log.gz 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44825.log 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47654.log.gz 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29354.log 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31247.log 2024-09-17T11:00:36.968 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65927.log.gz 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44825.log.gz 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55572.log 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29354.log.gz 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44127.log 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31247.log.gz 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.55572.log: -- /var/log/ceph/ceph-client.admin.58364.log 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55572.log.gz 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46922.log 2024-09-17T11:00:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44127.log.gz 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62036.log 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60266.log 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46922.log.gz 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.62036.log: --verbose -- /var/log/ceph/ceph-client.admin.33492.log 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62036.log.gz 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39381.log 2024-09-17T11:00:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60266.log.gz 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37721.log 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33492.log.gz 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39381.log.gz 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36524.log 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37721.log.gz 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35929.log 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38730.log: /var/log/ceph/ceph-client.admin.36524.log: 23.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz -- replaced with /var/log/ceph/ceph-client.admin.36524.log.gz 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:36.971 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50511.log 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38561.log 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35929.log.gz 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36354.log /var/log/ceph/ceph-client.admin.50511.log: 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50511.log.gz 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.38561.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65298.log 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38561.log.gz 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37952.log 2024-09-17T11:00:36.972 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36354.log.gz 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39633.log 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65298.log.gz 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34029.log 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37952.log.gz 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37034.log 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39633.log: 22.2% -- replaced with /var/log/ceph/ceph-client.admin.39633.log.gz 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27042.log 2024-09-17T11:00:36.973 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34029.log.gz 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68545.log 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37034.log.gz 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28690.log 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27042.log.gz 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55403.log 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68545.log.gz 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57218.log 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28690.log.gz 2024-09-17T11:00:36.974 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60885.log 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51900.log 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55403.log.gz 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57218.log.gz 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68801.log 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60885.log.gz 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33949.log 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51900.log.gz 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.68801.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37931.log 2024-09-17T11:00:36.975 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68801.log.gz 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70421.log 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33949.log.gz 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29955.log 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37931.log.gz 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29761.log 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70421.log.gz 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43164.log 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29955.log.gz 2024-09-17T11:00:36.976 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.29761.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29761.log.gz 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43164.log.gz 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28754.log 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-09-17T11:00:36.977 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36184.log 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28754.log.gz 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25753.log 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31397.log 2024-09-17T11:00:36.978 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25753.log.gz 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30831.log 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29162.log 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31397.log.gz 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25693.log 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30831.log.gz 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48474.log 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29162.log.gz 2024-09-17T11:00:36.979 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68029.log 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25693.log.gz 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52180.log 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48474.log.gz 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33152.log 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68029.log.gz 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51198.log 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52180.log: /var/log/ceph/ceph-client.admin.33152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52180.log.gz 2024-09-17T11:00:36.980 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33152.log.gz 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51198.log.gz 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57197.log 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56680.log 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2024-09-17T11:00:36.981 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54665.log 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57197.log.gz 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37221.log 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56680.log.gz 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68903.log 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54665.log.gz 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36932.log 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37221.log.gz 2024-09-17T11:00:36.982 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62077.log 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68903.log.gz 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58976.log 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36932.log.gz 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60327.log 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62077.log.gz 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58976.log.gz 2024-09-17T11:00:36.983 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49318.log 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60327.log.gz 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66508.log 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40969.log 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49318.log.gz 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57025.log 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66508.log.gz 2024-09-17T11:00:36.984 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30385.log 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40969.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.40969.log.gz--verbose 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr:-- /var/log/ceph/ceph-client.admin.69720.log 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50260.log 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57025.log.gz 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30385.log.gz 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69720.log.gz 2024-09-17T11:00:36.985 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46858.log 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50260.log.gz 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61838.log 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45319.log 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46858.log.gz 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30170.log 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61838.log.gz 2024-09-17T11:00:36.986 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54643.log 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45319.log.gz 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30170.log.gz 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53525.log 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54643.log.gz 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28668.log 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53280.log 2024-09-17T11:00:36.987 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53525.log.gz 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66701.log 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28668.log.gz 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58469.log 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53280.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.53280.log.gz 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39360.log 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66701.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66701.log.gz-5 2024-09-17T11:00:36.988 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.49900.log 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58469.log.gz 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52597.log 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39360.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39360.log.gz 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60496.log 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49900.log.gz 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45341.log 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52597.log.gz 2024-09-17T11:00:36.989 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56917.log 2024-09-17T11:00:36.990 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60496.log.gz 2024-09-17T11:00:36.992 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65358.log 2024-09-17T11:00:36.992 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45341.log.gz 2024-09-17T11:00:36.992 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33305.log 2024-09-17T11:00:36.993 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56917.log.gz 2024-09-17T11:00:36.993 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41758.log 2024-09-17T11:00:36.993 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65358.log.gz 2024-09-17T11:00:36.993 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48248.log 2024-09-17T11:00:36.993 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28883.log 2024-09-17T11:00:36.993 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33305.log.gz 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41758.log: 17.8% -- replaced with /var/log/ceph/ceph-client.admin.41758.log.gz 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41141.log 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48248.log.gz 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54579.log 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28883.log.gz 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27667.log 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41141.log.gz 2024-09-17T11:00:36.994 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57557.log 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53051.log 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54579.log.gz 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27667.log: /var/log/ceph/ceph-client.admin.57557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27667.log.gz 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30707.log 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57557.log.gz 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53051.log.gz 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68760.log 2024-09-17T11:00:36.995 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26150.log 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30707.log.gz 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51284.log 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68760.log.gz 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27647.log 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26150.log.gz 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46075.log 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51284.log.gz 2024-09-17T11:00:36.996 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51389.log 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27647.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27647.log.gz 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52008.log 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46075.log.gz 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49491.log 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51389.log.gz 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63886.log 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52008.log.gz 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62906.log 2024-09-17T11:00:36.997 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49491.log.gz 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67647.log 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63886.log.gz 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64431.log 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62906.log.gz 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26419.log 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61737.log 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.67647.log.gz 2024-09-17T11:00:36.998 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64431.log: /var/log/ceph/ceph-client.admin.26419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36847.log 2024-09-17T11:00:36.999 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64431.log.gz 2024-09-17T11:00:36.999 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26419.log.gz 2024-09-17T11:00:36.999 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50388.log 2024-09-17T11:00:36.999 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61737.log.gz 2024-09-17T11:00:36.999 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36847.log.gz 2024-09-17T11:00:36.999 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49168.log 2024-09-17T11:00:36.999 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65820.log 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50388.log.gz 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42727.log 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49168.log.gz 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55360.log 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65820.log.gz 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50617.log 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42727.log: /var/log/ceph/ceph-client.admin.55360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32659.log 2024-09-17T11:00:37.000 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42727.log.gz 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55360.log.gz 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69139.log 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50617.log.gz 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59062.log 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32659.log: gzip -5 1.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.32659.log.gz/var/log/ceph/ceph-client.admin.54600.log 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69139.log: /var/log/ceph/ceph-client.admin.59062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69139.log.gz 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51241.log 2024-09-17T11:00:37.001 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59062.log.gz 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26017.log 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54600.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54600.log.gz-5 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.45405.log 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57046.log 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51241.log.gz 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26017.log: /var/log/ceph/ceph-client.admin.45405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45405.log.gz 2024-09-17T11:00:37.002 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26017.log.gz 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28174.log 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57046.log.gz 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49577.log: /var/log/ceph/ceph-client.admin.34149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56639.log 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63281.log 2024-09-17T11:00:37.003 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28174.log.gz 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50222.log 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56639.log.gz 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67668.log 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63281.log.gz 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44168.log 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50222.log.gz 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64080.log 2024-09-17T11:00:37.004 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64161.log 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67668.log.gz 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61055.log 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64080.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.44168.log.gz 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64080.log.gz 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.64161.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32216.log 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64161.log.gz 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65171.log 2024-09-17T11:00:37.005 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61055.log.gz 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35209.log 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32216.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32216.log.gz 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38540.log 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65171.log.gz 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41033.log 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35209.log.gz 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34589.log 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38540.log: /var/log/ceph/ceph-client.admin.41033.log: gzip -5 23.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38540.log.gz 2024-09-17T11:00:37.006 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39977.log 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41033.log.gz 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47352.log 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34589.log: /var/log/ceph/ceph-client.admin.39977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34589.log.gz 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39977.log.gz 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48080.log 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49792.log 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2024-09-17T11:00:37.007 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63532.log 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48080.log: /var/log/ceph/ceph-client.admin.49792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48080.log.gz 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60287.log 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49792.log.gz 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62882.log 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63532.log.gz 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49921.log 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60287.log.gz 2024-09-17T11:00:37.008 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51219.log 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62882.log.gz 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39719.log 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49921.log.gz 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30492.log 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51219.log.gz 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60982.log 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39719.log.gz 2024-09-17T11:00:37.009 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52925.log 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30492.log.gz 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60982.log.gz 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59212.log 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52925.log.gz 2024-09-17T11:00:37.010 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29826.log 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45753.log 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59212.log.gz 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58673.log 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29826.log.gz 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.45753.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34469.log 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45753.log.gz 2024-09-17T11:00:37.011 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52309.log 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70285.log 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58673.log.gz 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34469.log: /var/log/ceph/ceph-client.admin.52309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34469.log.gz 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60691.log 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52309.log.gz 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34529.log 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70285.log.gz 2024-09-17T11:00:37.012 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47834.log 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60691.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.60691.log.gz 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28926.log 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34529.log.gz 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47834.log.gz 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28926.log.gz 2024-09-17T11:00:37.013 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58162.log 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30866.log 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58162.log.gz 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60008.log 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67067.log 2024-09-17T11:00:37.014 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30866.log.gz 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50366.log 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60008.log.gz 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46183.log 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67067.log.gz 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45212.log 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50366.log.gz 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63665.log 2024-09-17T11:00:37.015 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46183.log.gz 2024-09-17T11:00:37.016 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45298.log 2024-09-17T11:00:37.016 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45212.log.gz 2024-09-17T11:00:37.016 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43288.log 2024-09-17T11:00:37.016 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63665.log.gz 2024-09-17T11:00:37.016 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62326.log 2024-09-17T11:00:37.016 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2024-09-17T11:00:37.016 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34009.log 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43288.log.gz 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62326.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.52477.log -- replaced with /var/log/ceph/ceph-client.admin.62326.log.gz 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35895.log 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34009.log.gz 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59986.log 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52477.log.gz 2024-09-17T11:00:37.017 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.35895.log: -- /var/log/ceph/ceph-client.admin.40300.log 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35895.log.gz 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68968.log 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59986.log.gz 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40300.log.gzgzip 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.51986.log 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66336.log 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68968.log.gz 2024-09-17T11:00:37.018 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60961.log 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51986.log.gz 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37826.log 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66336.log.gz 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46639.log 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60961.log.gz 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55981.log 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37826.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37826.log.gz 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48635.log 2024-09-17T11:00:37.019 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55981.log.gz 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27799.log 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48635.log.gz 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58569.log 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45018.log 2024-09-17T11:00:37.020 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27799.log.gz 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29204.log 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58569.log.gz 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68459.log 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45018.log.gz 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.29204.log: -- /var/log/ceph/ceph-client.admin.43101.log 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29204.log.gz 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55938.log 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68459.log.gz 2024-09-17T11:00:37.021 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.43101.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.20996.log 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43101.log.gz 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50136.log 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55938.log.gz 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.20996.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69419.log 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20996.log.gz 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38919.log 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50136.log.gz 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2024-09-17T11:00:37.022 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69419.log.gz 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37357.log 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38919.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38919.log.gz 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48122.log 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37357.log.gz 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58341.log 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56720.log 2024-09-17T11:00:37.023 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48122.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.48122.log.gzgzip 2024-09-17T11:00:37.024 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.58182.log 2024-09-17T11:00:37.024 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58341.log.gz 2024-09-17T11:00:37.024 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51537.log 2024-09-17T11:00:37.024 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56720.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.56720.log.gz 2024-09-17T11:00:37.024 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69888.log 2024-09-17T11:00:37.024 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58182.log.gz 2024-09-17T11:00:37.024 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51537.log: /var/log/ceph/ceph-client.admin.40386.log 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.51537.log.gz 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66766.log 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69888.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.69888.log.gz 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.66766.log: --verbose -- /var/log/ceph/ceph-client.admin.42521.log 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66766.log.gz 2024-09-17T11:00:37.025 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log /var/log/ceph/ceph-client.admin.53847.log: 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67131.log 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42521.log: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.42521.log.gz 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52437.log 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32727.log: /var/log/ceph/ceph-client.admin.67131.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38898.log 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67131.log.gz 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50201.log 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52437.log.gz 2024-09-17T11:00:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42285.log 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38898.log: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.38898.log.gz 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31440.log 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50201.log.gz 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29590.log 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42285.log: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.42285.log.gz 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49857.log 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31440.log.gz 2024-09-17T11:00:37.027 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36286.log 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29590.log.gz 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70394.log 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49857.log.gz 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67460.log 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36286.log.gz 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38414.log 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70394.log.gz 2024-09-17T11:00:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70502.log 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67460.log.gz 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59578.log 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38414.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38414.log.gz 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37910.log 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70502.log.gz 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34649.log 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59578.log.gz 2024-09-17T11:00:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37910.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37910.log.gz 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69871.log 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58933.log 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34649.log.gz 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65734.log 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69871.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69871.log.gz 2024-09-17T11:00:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66830.log 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58933.log.gz 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67943.log 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65734.log.gz 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31037.log /var/log/ceph/ceph-client.admin.66830.log: 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66830.log.gz 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.67943.log: --verbose -- /var/log/ceph/ceph-client.admin.61405.log 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67943.log.gz 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64560.log 2024-09-17T11:00:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31037.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.31037.log.gz--verbose 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr:-- /var/log/ceph/ceph-client.admin.27107.log 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61405.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61405.log.gz-5 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.52201.log 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64560.log.gz 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38099.log 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27107.log.gz 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64796.log 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52201.log.gz 2024-09-17T11:00:37.032 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38099.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38099.log.gz 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33869.log 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64796.log.gz 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41613.log 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65070.log 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33869.log.gz 2024-09-17T11:00:37.033 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28303.log 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41613.log.gz 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46161.log 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65070.log.gz 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36728.log 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28303.log.gz 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46161.log.gz 2024-09-17T11:00:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40449.log 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.36728.log: --verbose -- /var/log/ceph/ceph-client.admin.29001.log 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36728.log.gz 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45040.log 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40449.log.gz 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44760.log 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29001.log: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.29001.log.gz 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44231.log 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45040.log.gz 2024-09-17T11:00:37.035 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44760.log.gz 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66142.log 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44231.log.gz 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57787.log 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37658.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43081.log 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50961.log 2024-09-17T11:00:37.036 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66142.log.gz 2024-09-17T11:00:37.037 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57787.log: /var/log/ceph/ceph-client.admin.43081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52357.log 2024-09-17T11:00:37.037 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57787.log.gz 2024-09-17T11:00:37.037 INFO:teuthology.orchestra.run.smithi184.stderr: 56.0% -- replaced with /var/log/ceph/ceph-client.admin.43081.log.gz 2024-09-17T11:00:37.037 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27533.log 2024-09-17T11:00:37.037 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50961.log.gz 2024-09-17T11:00:37.037 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.52357.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26569.log 2024-09-17T11:00:37.037 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52357.log.gz 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61880.log 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27533.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27533.log.gz 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64026.log 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26569.log.gz 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50050.log 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61880.log.gz 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57455.log 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64026.log.gz 2024-09-17T11:00:37.038 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27989.log 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50050.log.gz 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.57455.log: --verbose -- /var/log/ceph/ceph-client.admin.68674.log 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57455.log.gz 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57498.log 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27989.log.gz 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25646.log 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54385.log 2024-09-17T11:00:37.039 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68674.log.gz 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57498.log.gz 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42564.log 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25646.log.gz 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29418.log 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54385.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54385.log.gz 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.69118.log 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59019.log 2024-09-17T11:00:37.040 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29418.log.gz 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69118.log.gz 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60574.log 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59019.log.gz 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32778.log 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39549.log 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60574.log.gz 2024-09-17T11:00:37.041 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58549.log 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36320.log 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32778.log.gz 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39549.log: 22.3% -- replaced with /var/log/ceph/ceph-client.admin.39549.log.gz 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26548.log 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58549.log.gz 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69397.log 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36320.log.gz 2024-09-17T11:00:37.042 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58692.log 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26548.log.gz 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58612.log /var/log/ceph/ceph-client.admin.69397.log: 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69397.log.gz 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37459.log 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58692.log.gz 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63805.log 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58612.log.gz 2024-09-17T11:00:37.043 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33203.log 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37459.log.gz 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60479.log 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63805.log.gz 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.33203.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47374.log 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33203.log.gz 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27085.log 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60479.log.gz 2024-09-17T11:00:37.044 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30320.log 2024-09-17T11:00:37.045 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47374.log.gz 2024-09-17T11:00:37.045 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69053.log 2024-09-17T11:00:37.045 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27085.log.gz 2024-09-17T11:00:37.045 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50243.log 2024-09-17T11:00:37.045 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30320.log.gz 2024-09-17T11:00:37.045 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-09-17T11:00:37.045 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69053.log.gz 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59556.log 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50243.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50243.log.gz 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57710.log 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49426.log 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59556.log.gz 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41420.log 2024-09-17T11:00:37.046 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57710.log.gz 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31228.log 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49426.log.gz 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37051.log 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41420.log.gz 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66099.log 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31228.log.gz 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64861.log 2024-09-17T11:00:37.047 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37051.log.gz 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66099.log: /var/log/ceph/ceph-client.admin.42326.log 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66099.log.gz 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40883.log 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64861.log.gz 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40947.log 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42326.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57592.log 2024-09-17T11:00:37.048 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40883.log.gz 2024-09-17T11:00:37.049 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39150.log 2024-09-17T11:00:37.049 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40947.log.gz 2024-09-17T11:00:37.049 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67045.log 2024-09-17T11:00:37.049 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57592.log.gz 2024-09-17T11:00:37.049 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57068.log 2024-09-17T11:00:37.049 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57261.log 2024-09-17T11:00:37.049 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39150.log.gz 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67045.log.gz 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51433.log 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57068.log.gz 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28625.log 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57261.log.gz 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51433.log.gz 2024-09-17T11:00:37.050 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67153.log 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28625.log.gz 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70448.log 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67153.log.gz 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61232.log 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70448.log.gz 2024-09-17T11:00:37.051 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35861.log 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.61232.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31677.log 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61232.log.gz 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35861.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35861.log.gz 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61445.log 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31677.log.gz 2024-09-17T11:00:37.052 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40579.log 2024-09-17T11:00:37.053 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66981.log 2024-09-17T11:00:37.053 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61445.log: 51.3%/var/log/ceph/ceph-client.admin.40579.log: -- replaced with /var/log/ceph/ceph-client.admin.61445.log.gz 2024-09-17T11:00:37.053 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55895.log 2024-09-17T11:00:37.053 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40579.log.gz 2024-09-17T11:00:37.053 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38772.log 2024-09-17T11:00:37.053 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66981.log.gz 2024-09-17T11:00:37.053 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42126.log 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55895.log.gz 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35878.log 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38772.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38772.log.gz 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64062.log 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42126.log.gz 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29933.log 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35878.log.gz 2024-09-17T11:00:37.054 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32063.log 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64062.log.gz 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29124.log 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29933.log.gz 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59900.log 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69569.log 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32063.log.gz 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29124.log.gz 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55658.log 2024-09-17T11:00:37.055 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59900.log.gz 2024-09-17T11:00:37.056 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44631.log 2024-09-17T11:00:37.056 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69569.log.gz 2024-09-17T11:00:37.056 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29869.log 2024-09-17T11:00:37.056 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55658.log.gz 2024-09-17T11:00:37.056 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54686.log 2024-09-17T11:00:37.056 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44631.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.44631.log.gz 2024-09-17T11:00:37.056 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27438.log 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29869.log.gz 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26698.log 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54686.log.gz 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56067.log 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27438.log.gz 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37847.log 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26698.log.gz 2024-09-17T11:00:37.057 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56067.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.56067.log.gz/var/log/ceph/ceph-client.admin.63568.log 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37847.log: /var/log/ceph/ceph-client.admin.48575.log 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.37847.log.gz 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63568.log.gz 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.48575.log: -- /var/log/ceph/ceph-client.admin.30814.log 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2024-09-17T11:00:37.058 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log /var/log/ceph/ceph-client.admin.33339.log: 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.30814.log: --verbose -- /var/log/ceph/ceph-client.admin.66121.log 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.30814.log.gz 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58124.log 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33101.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56619.log 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66121.log.gz 2024-09-17T11:00:37.059 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.58124.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65480.log 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58124.log.gz 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69869.log 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56619.log.gz 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53301.log 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65480.log: /var/log/ceph/ceph-client.admin.69869.log: gzip -5 53.1%--verbose -- replaced with /var/log/ceph/ceph-client.admin.65480.log.gz-- 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29289.log 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69869.log.gz 2024-09-17T11:00:37.060 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47777.log 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53301.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.53301.log.gz 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46721.log 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29289.log.gz 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43184.log 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47777.log.gz 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46721.log.gz 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57433.log 2024-09-17T11:00:37.061 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59298.log 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43184.log.gz 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33909.log 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57433.log.gz 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54364.log 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59298.log.gz 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52457.log 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33909.log.gz 2024-09-17T11:00:37.062 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34989.log 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54364.log.gz 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69010.log 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52457.log.gz 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39870.log 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34989.log.gz 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.69010.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66787.log 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69010.log.gz 2024-09-17T11:00:37.063 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42873.log 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39870.log.gz 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26505.log 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66787.log.gz 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49642.log 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42873.log.gz 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26505.log.gz 2024-09-17T11:00:37.064 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50115.log 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49642.log.gz 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51305.log 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43038.log 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50115.log.gz 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.51305.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49835.log 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51305.log.gz 2024-09-17T11:00:37.065 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42006.log 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43038.log.gz 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57692.log 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49835.log.gz 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42006.log.gz 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55680.log 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57692.log.gz 2024-09-17T11:00:37.066 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30084.log 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.55680.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55680.log.gz 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38204.log 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30084.log.gz 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55173.log 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-09-17T11:00:37.067 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60308.log 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38204.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38204.log.gz 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55173.log.gz 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67785.log 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60308.log.gz 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.45903.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2024-09-17T11:00:37.068 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67785.log.gz 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31849.log 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20874.log 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30884.log 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62708.log 2024-09-17T11:00:37.069 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31849.log.gz 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.20874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20874.log.gz 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39741.log 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30884.log.gz 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61660.log 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62708.log.gz 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43244.log 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39741.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.40926.log 2024-09-17T11:00:37.070 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39741.log.gz 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61660.log.gz 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62289.log 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43244.log: 55.8% -- replaced with /var/log/ceph/ceph-client.admin.43244.log.gz 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27951.log 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40926.log.gz 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46581.log 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62289.log.gz 2024-09-17T11:00:37.071 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34749.log 2024-09-17T11:00:37.072 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27951.log.gz 2024-09-17T11:00:37.072 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T11:00:37.072 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46581.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.46581.log.gz 2024-09-17T11:00:37.072 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57969.log 2024-09-17T11:00:37.072 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34749.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2024-09-17T11:00:37.072 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34749.log.gz 2024-09-17T11:00:37.072 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27857.log 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57969.log.gz 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34169.log 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27857.log.gz 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr: 88.2%gzip /var/log/ceph/ceph-client.admin.43491.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.59449.log 2024-09-17T11:00:37.073 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2024-09-17T11:00:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31698.log 2024-09-17T11:00:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34169.log: /var/log/ceph/ceph-client.admin.59449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34169.log.gz 2024-09-17T11:00:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-09-17T11:00:37.074 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59449.log.gz 2024-09-17T11:00:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51793.log 2024-09-17T11:00:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31698.log.gz 2024-09-17T11:00:37.074 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27931.log 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35569.log 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51793.log.gz 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log /var/log/ceph/ceph-client.admin.27931.log: 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27931.log.gz 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59728.log 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35569.log.gz 2024-09-17T11:00:37.075 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62426.log 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38015.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gzgzip 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.37187.log 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59728.log.gz 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34689.log 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62426.log.gz 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26440.log 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37187.log.gz 2024-09-17T11:00:37.076 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59470.log 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34689.log.gz 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42484.log 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26440.log.gz 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67685.log 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59470.log.gz 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr: 58.7% -- replaced with /var/log/ceph/ceph-client.admin.42484.log.gz 2024-09-17T11:00:37.077 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67399.log 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67685.log.gz 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70772.log 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70583.log 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67399.log.gz 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61717.log 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70772.log.gz 2024-09-17T11:00:37.078 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51814.log 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70583.log.gz 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26978.log 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61717.log.gz 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67232.log 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51814.log.gz 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52580.log 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26978.log.gz 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60399.log 2024-09-17T11:00:37.079 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67232.log: 13.6% -- replaced with /var/log/ceph/ceph-client.admin.67232.log.gz 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.52580.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37700.log 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52580.log.gz 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68136.log 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60399.log.gz 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30342.log 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57830.log 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37700.log.gz 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68136.log: gzip /var/log/ceph/ceph-client.admin.30342.log: -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.68136.log.gz-- 2024-09-17T11:00:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42646.log 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30342.log.gz 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41674.log 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57830.log.gz 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43351.log 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42646.log.gz 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41674.log.gz 2024-09-17T11:00:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35129.log 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43351.log.gz 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38603.log 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55235.log 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35129.log.gz 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61757.log 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70610.log 2024-09-17T11:00:37.082 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38603.log.gz 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55235.log.gz 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42956.log 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61757.log.gz 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70610.log.gz 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64345.log 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42956.log.gz 2024-09-17T11:00:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57987.log 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65150.log 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64345.log.gz 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59535.log 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57987.log.gz 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69526.log 2024-09-17T11:00:37.084 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65150.log.gz 2024-09-17T11:00:37.085 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59535.log.gz 2024-09-17T11:00:37.085 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25594.log 2024-09-17T11:00:37.085 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz 2024-09-17T11:00:37.085 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43569.log 2024-09-17T11:00:37.085 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69526.log.gz 2024-09-17T11:00:37.085 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68351.log 2024-09-17T11:00:37.085 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25594.log.gz 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52244.log 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43569.log.gz 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66207.log 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68351.log.gz 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49749.log 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52244.log.gz 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51176.log 2024-09-17T11:00:37.086 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66207.log.gz 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48142.log 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49749.log.gz 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51176.log.gz 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.48142.log: -- /var/log/ceph/ceph-client.admin.68072.log 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48142.log.gz 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-09-17T11:00:37.087 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45061.log 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68072.log.gz 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.31655.log: -- /var/log/ceph/ceph-client.admin.65777.log 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33458.log 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45061.log.gz 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27412.log 2024-09-17T11:00:37.088 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65777.log.gz 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30299.log 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33458.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33458.log.gz 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25910.log 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27412.log.gz 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.30299.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41861.log 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30299.log.gz 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40321.log 2024-09-17T11:00:37.089 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25910.log.gz 2024-09-17T11:00:37.090 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61979.log 2024-09-17T11:00:37.090 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41861.log.gz 2024-09-17T11:00:37.090 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40798.log 2024-09-17T11:00:37.090 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40321.log.gz 2024-09-17T11:00:37.090 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32097.log 2024-09-17T11:00:37.090 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61979.log.gz 2024-09-17T11:00:37.090 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56131.log 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40798.log.gz 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66164.log 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32097.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32097.log.gz 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65130.log 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56131.log.gz 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50768.log 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66164.log.gz 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63966.log 2024-09-17T11:00:37.091 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65130.log: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.65130.log.gz 2024-09-17T11:00:37.092 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52560.log 2024-09-17T11:00:37.092 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50768.log.gz 2024-09-17T11:00:37.092 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56788.log 2024-09-17T11:00:37.092 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63966.log.gz 2024-09-17T11:00:37.092 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54944.log 2024-09-17T11:00:37.092 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52560.log.gz 2024-09-17T11:00:37.092 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38141.log 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56788.log.gz 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.54944.log: --verbose -- /var/log/ceph/ceph-client.admin.69655.log 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54944.log.gz 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29461.log 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38141.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38141.log.gz 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44148.log 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69655.log.gz 2024-09-17T11:00:37.093 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29461.log: /var/log/ceph/ceph-client.admin.42244.log 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29461.log.gz 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60923.log 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.44148.log.gz 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27457.log 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42244.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.42244.log.gz 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36643.log 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60923.log.gz 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69268.log 2024-09-17T11:00:37.094 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27457.log.gz 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68416.log 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36643.log.gz 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59922.log 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69268.log.gz 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41076.log 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68416.log.gz 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-09-17T11:00:37.095 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59922.log.gz 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52417.log 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41076.log.gz 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63199.log 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26612.log 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52417.log.gz 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59148.log 2024-09-17T11:00:37.096 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63199.log.gz 2024-09-17T11:00:37.097 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31095.log 2024-09-17T11:00:37.097 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26612.log.gz 2024-09-17T11:00:37.097 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56960.log 2024-09-17T11:00:37.097 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59148.log.gz 2024-09-17T11:00:37.097 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41162.log 2024-09-17T11:00:37.097 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31095.log.gz 2024-09-17T11:00:37.097 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28432.log 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56960.log.gz 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54987.log 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41162.log.gz 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32591.log 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28432.log.gz 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69591.log 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54987.log.gz 2024-09-17T11:00:37.098 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32591.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32591.log.gz 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45839.log 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69591.log.gz 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62569.log 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44069.log: /var/log/ceph/ceph-client.admin.45839.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29242.log 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45839.log.gz 2024-09-17T11:00:37.099 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66723.log 2024-09-17T11:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62569.log: 55.4% -- replaced with /var/log/ceph/ceph-client.admin.62569.log.gz 2024-09-17T11:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61961.log 2024-09-17T11:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29242.log.gz 2024-09-17T11:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2024-09-17T11:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66723.log.gz 2024-09-17T11:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62942.log 2024-09-17T11:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61961.log.gz 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39108.log 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26526.log 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62942.log.gz 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70122.log 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39108.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.39108.log.gz 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34049.log 2024-09-17T11:00:37.101 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26526.log.gz 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68736.log 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70122.log.gz 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63259.log 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34049.log.gz 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65521.log 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68736.log.gz 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-09-17T11:00:37.102 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63259.log: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.63259.log.gz 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65521.log.gz 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53589.log 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54557.log 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38856.log 2024-09-17T11:00:37.103 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53589.log.gz 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36201.log 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54557.log.gz 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54062.log 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38856.log.gz 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53071.log 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36201.log.gz 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32301.log 2024-09-17T11:00:37.104 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54062.log.gz 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67212.log 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53071.log.gz 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58243.log 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32301.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32301.log.gz 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35997.log 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67212.log.gz 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66529.log 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58243.log.gz 2024-09-17T11:00:37.105 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47755.log 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35997.log.gz 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63588.log 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66529.log.gz 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32080.log 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47755.log.gz 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52761.log 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63588.log.gz 2024-09-17T11:00:37.106 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.32080.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32080.log.gz 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54040.log 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52761.log.gz 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52658.log 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54040.log.gz 2024-09-17T11:00:37.107 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57132.log 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52658.log.gz 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35189.log 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57369.log 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57132.log.gz 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32846.log 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35189.log.gz 2024-09-17T11:00:37.108 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33135.log 2024-09-17T11:00:37.109 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57369.log.gz 2024-09-17T11:00:37.109 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37000.log 2024-09-17T11:00:37.109 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32846.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32846.log.gz 2024-09-17T11:00:37.109 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33135.log: /var/log/ceph/ceph-client.admin.53111.log 2024-09-17T11:00:37.109 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33135.log.gz 2024-09-17T11:00:37.109 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36762.log 2024-09-17T11:00:37.109 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37000.log.gz 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53111.log.gz 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59277.log 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36762.log.gz 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.43429.log: -- /var/log/ceph/ceph-client.admin.32148.log 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57519.log 2024-09-17T11:00:37.110 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59277.log.gz 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61001.log 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32148.log.gz 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39402.log 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57519.log.gz 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69311.log 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61001.log.gz 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.39402.log: -- /var/log/ceph/ceph-client.admin.63002.log 2024-09-17T11:00:37.111 INFO:teuthology.orchestra.run.smithi184.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.39402.log.gz 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62193.log 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69311.log.gz 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.63002.log: -- /var/log/ceph/ceph-client.admin.51413.log 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63002.log.gz 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62193.log.gz 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28981.log 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz 2024-09-17T11:00:37.112 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37340.log 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35489.log 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28981.log.gz 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37637.log 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37340.log.gz 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53091.log 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35489.log.gz 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27893.log 2024-09-17T11:00:37.113 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37637.log.gz 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.53091.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27571.log 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53091.log.gz 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63318.log 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27893.log.gz 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67272.log 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27571.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27571.log.gz 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31290.log 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63318.log.gz 2024-09-17T11:00:37.114 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28647.log 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67272.log.gz 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31290.log.gz 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70095.log 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28647.log.gz 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42666.log 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61677.log 2024-09-17T11:00:37.115 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70095.log.gz 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31354.log 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42666.log.gz 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51517.log 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61677.log.gz 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53825.log 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31354.log.gz 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2024-09-17T11:00:37.116 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64646.log 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.51517.log.gz 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53825.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.53825.log.gz 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34329.log 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20969.log 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64646.log.gz 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33475.log 2024-09-17T11:00:37.117 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34329.log.gz 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40861.log 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.20969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27171.log 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20969.log.gz 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33475.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33475.log.gz 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40428.log 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40861.log.gz 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46011.log 2024-09-17T11:00:37.118 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27171.log.gz 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63926.log 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40428.log.gz 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27392.log 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46011.log.gz 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27819.log 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63926.log.gz 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40128.log 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27392.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27392.log.gz 2024-09-17T11:00:37.119 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48454.log 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27819.log.gz 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44846.log 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40128.log.gz 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52864.log 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48454.log.gz 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41820.log 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44846.log.gz 2024-09-17T11:00:37.120 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37476.log 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52864.log.gz 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68179.log 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41820.log: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.41820.log.gz 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34889.log 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37476.log.gz 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65542.log 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68179.log.gz 2024-09-17T11:00:37.121 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40486.log 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34889.log.gz 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62015.log 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35509.log 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65542.log.gz 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40486.log.gz 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37289.log 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62015.log.gz 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63492.log 2024-09-17T11:00:37.122 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35509.log.gz 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32199.log 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37289.log.gz 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25666.log 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63492.log.gz 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26677.log 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32199.log: gzip 1.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.32199.log.gz--verbose 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:-- /var/log/ceph/ceph-client.admin.44347.log 2024-09-17T11:00:37.123 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25666.log.gz 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30256.log 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26677.log.gz 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42305.log 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44347.log.gz 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55723.log 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30256.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.30256.log.gz-- 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64366.log 2024-09-17T11:00:37.124 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32404.log 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr: 54.5%/var/log/ceph/ceph-client.admin.55723.log: -- replaced with /var/log/ceph/ceph-client.admin.42305.log.gz 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55723.log.gz 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64366.log.gz 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27629.log 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32404.log.gz 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45516.log 2024-09-17T11:00:37.125 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31569.log 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27629.log.gz 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64409.log 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45516.log.gz 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34109.log 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31569.log.gz 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63765.log 2024-09-17T11:00:37.126 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64409.log.gz 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30643.log 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34109.log.gz 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29719.log 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63765.log.gz 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26870.log 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30643.log.gz 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42853.log 2024-09-17T11:00:37.127 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29719.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.29719.log.gz-5 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.61154.log 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26870.log.gz 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53440.log 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42853.log: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.42853.log.gz 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39129.log 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61154.log: 56.0% -- replaced with /var/log/ceph/ceph-client.admin.61154.log.gz 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31116.log 2024-09-17T11:00:37.128 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53440.log.gz 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65863.log 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39045.log 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39129.log.gz 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31116.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.31116.log.gz 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37679.log 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65863.log.gz 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56460.log 2024-09-17T11:00:37.129 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39045.log: 23.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39045.log.gz-5 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.39528.log 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37679.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.37679.log.gz 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28819.log 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56460.log.gz 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36167.log 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.39528.log.gz 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62726.log 2024-09-17T11:00:37.130 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28819.log.gz 2024-09-17T11:00:37.131 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42504.log 2024-09-17T11:00:37.131 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36167.log.gz 2024-09-17T11:00:37.131 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63179.log 2024-09-17T11:00:37.131 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62726.log.gz 2024-09-17T11:00:37.131 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2024-09-17T11:00:37.131 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42504.log: 15.7% -- replaced with /var/log/ceph/ceph-client.admin.42504.log.gz 2024-09-17T11:00:37.131 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68308.log 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63179.log.gz 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44027.log 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46619.log 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68308.log.gz 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62446.log 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.44027.log.gz 2024-09-17T11:00:37.132 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59943.log 2024-09-17T11:00:37.133 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46619.log.gz 2024-09-17T11:00:37.133 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32557.log 2024-09-17T11:00:37.133 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62446.log.gz 2024-09-17T11:00:37.133 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40343.log 2024-09-17T11:00:37.133 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59943.log.gz 2024-09-17T11:00:37.133 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62249.log 2024-09-17T11:00:37.133 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32557.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32557.log.gz 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30277.log 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40343.log.gz 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44468.log 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62249.log.gz 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58145.log 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30277.log.gz 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51155.log 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44468.log.gz 2024-09-17T11:00:37.134 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67584.log 2024-09-17T11:00:37.135 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58145.log.gz 2024-09-17T11:00:37.135 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70691.log 2024-09-17T11:00:37.135 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51155.log.gz 2024-09-17T11:00:37.135 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61135.log 2024-09-17T11:00:37.135 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67584.log.gz 2024-09-17T11:00:37.135 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63119.log 2024-09-17T11:00:37.135 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70691.log.gz 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61505.log 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61135.log.gz 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31892.log 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63119.log.gz 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67705.log 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61505.log.gz 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55787.log 2024-09-17T11:00:37.136 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31892.log.gz 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31612.log 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67705.log.gz 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64044.log 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55787.log.gz 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31612.log: /var/log/ceph/ceph-client.admin.56281.log 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31612.log.gz 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65338.log 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64044.log.gz 2024-09-17T11:00:37.137 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55551.log 2024-09-17T11:00:37.138 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56281.log.gz 2024-09-17T11:00:37.138 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53461.log 2024-09-17T11:00:37.138 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65338.log.gz 2024-09-17T11:00:37.138 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42936.log 2024-09-17T11:00:37.138 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55551.log.gz 2024-09-17T11:00:37.138 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48846.log 2024-09-17T11:00:37.138 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38982.log 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53461.log.gz 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42936.log.gz 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27609.log 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48846.log.gz 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48975.log 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38982.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38982.log.gz 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32335.log 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27609.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27609.log.gz 2024-09-17T11:00:37.139 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56338.log 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48975.log.gz 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56088.log 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32335.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32335.log.gz 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69462.log 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56338.log.gz 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.56088.log: --verbose -- /var/log/ceph/ceph-client.admin.62982.log 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56088.log.gz 2024-09-17T11:00:37.140 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48183.log 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69462.log: /var/log/ceph/ceph-client.admin.62982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69462.log.gz 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62172.log 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62982.log.gz 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48183.log.gz 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52822.log 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62172.log: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.62172.log.gz 2024-09-17T11:00:37.141 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60764.log 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55194.log 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52822.log.gz 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70718.log 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60764.log.gz 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41528.log 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55194.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55194.log.gz-5 2024-09-17T11:00:37.142 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.27761.log 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70718.log.gz 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60344.log 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41528.log.gz 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64732.log 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63059.log 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27761.log.gz 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60344.log.gz 2024-09-17T11:00:37.143 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.64732.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33526.log 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64732.log.gz 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63551.log 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63059.log.gz 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64689.log 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33526.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33526.log.gz 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63551.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.63551.log.gz 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.70367.log 2024-09-17T11:00:37.144 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49404.log 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64689.log.gz 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.70367.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70367.log.gz 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40737.log 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49404.log.gz 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-09-17T11:00:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55959.log 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40737.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.40737.log.gz 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26935.log 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44289.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34509.log 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55959.log.gz 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26935.log.gz 2024-09-17T11:00:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59664.log 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34509.log.gz 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54901.log 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69798.log 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59664.log.gz 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53504.log 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54901.log.gz 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41356.log 2024-09-17T11:00:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69798.log.gz 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37425.log 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53504.log.gz 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34729.log 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41356.log.gz 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37742.log 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37425.log.gz 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.34729.log: -- /var/log/ceph/ceph-client.admin.33715.log 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34729.log.gz 2024-09-17T11:00:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63725.log 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37742.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37742.log.gz 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49103.log 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33715.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65236.log 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63725.log.gz 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40235.log 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49103.log.gz 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54342.log 2024-09-17T11:00:37.149 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65236.log.gz 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40235.log.gz 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59513.log 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54342.log.gz 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37170.log 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51578.log 2024-09-17T11:00:37.150 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59513.log.gz 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51112.log 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35449.log 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37170.log.gz 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51578.log.gz 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39486.log 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51112.log.gz 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30924.log 2024-09-17T11:00:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35449.log.gz 2024-09-17T11:00:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65033.log 2024-09-17T11:00:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39486.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39486.log.gz 2024-09-17T11:00:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70854.log 2024-09-17T11:00:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30924.log.gz 2024-09-17T11:00:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32965.log 2024-09-17T11:00:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65033.log.gz 2024-09-17T11:00:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39956.log 2024-09-17T11:00:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70854.log.gz 2024-09-17T11:00:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2024-09-17T11:00:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32965.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32965.log.gz 2024-09-17T11:00:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28112.log 2024-09-17T11:00:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39956.log.gz 2024-09-17T11:00:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45169.log 2024-09-17T11:00:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52637.log 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28112.log.gz 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57175.log 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45169.log.gz 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52637.log.gz 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49082.log 2024-09-17T11:00:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57175.log.gz 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55131.log 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35980.log 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49082.log.gz 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31998.log 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55131.log.gz 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49039.log 2024-09-17T11:00:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-09-17T11:00:37.156 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28518.log 2024-09-17T11:00:37.156 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31998.log.gz 2024-09-17T11:00:37.156 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27430.log 2024-09-17T11:00:37.156 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49039.log.gz 2024-09-17T11:00:37.156 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51943.log 2024-09-17T11:00:37.156 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28518.log.gz 2024-09-17T11:00:37.156 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27430.log.gz 2024-09-17T11:00:37.157 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40020.log 2024-09-17T11:00:37.157 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60094.log 2024-09-17T11:00:37.157 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51943.log.gz 2024-09-17T11:00:37.157 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27685.log 2024-09-17T11:00:37.157 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40020.log.gz 2024-09-17T11:00:37.157 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57952.log 2024-09-17T11:00:37.157 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60094.log.gz 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68222.log 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27685.log.gz 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55529.log 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57952.log.gz 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39784.log 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43371.log 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68222.log.gz 2024-09-17T11:00:37.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62844.log 2024-09-17T11:00:37.159 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55529.log.gz 2024-09-17T11:00:37.159 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39784.log.gz 2024-09-17T11:00:37.159 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45384.log 2024-09-17T11:00:37.159 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43371.log.gz 2024-09-17T11:00:37.159 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34209.log 2024-09-17T11:00:37.159 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62844.log.gz 2024-09-17T11:00:37.159 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32710.log 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66185.log 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45384.log.gz 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33829.log 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34209.log.gz 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32710.log.gz 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66185.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66185.log.gz-5 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.70339.log 2024-09-17T11:00:37.160 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61859.log 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33829.log: /var/log/ceph/ceph-client.admin.70339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33829.log.gz 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43549.log 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70339.log.gz 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28281.log 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61859.log: /var/log/ceph/ceph-client.admin.43549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61859.log.gz 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43549.log.gz 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.47223.log 2024-09-17T11:00:37.161 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33560.log 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28281.log.gz 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51965.log 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47223.log.gz 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69182.log 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33560.log: gzip 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33560.log.gz-5 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.60823.log 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51965.log.gz 2024-09-17T11:00:37.162 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54514.log 2024-09-17T11:00:37.163 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69182.log.gz 2024-09-17T11:00:37.163 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58713.log 2024-09-17T11:00:37.163 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60823.log.gz 2024-09-17T11:00:37.163 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63945.log 2024-09-17T11:00:37.163 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53031.log 2024-09-17T11:00:37.163 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54514.log.gz 2024-09-17T11:00:37.163 INFO:teuthology.orchestra.run.smithi184.stderr: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.58713.log.gz 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58761.log 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63945.log.gz 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56024.log 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58890.log 0.0% 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53031.log.gz 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58761.log.gz 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37805.log 2024-09-17T11:00:37.164 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56024.log.gz 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29633.log 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58890.log.gz 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39999.log 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37805.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37805.log.gz 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40716.log 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29633.log.gz 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47916.log 2024-09-17T11:00:37.165 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39999.log.gz 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28561.log 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58782.log 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40716.log.gz 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47916.log.gz 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67964.log 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28561.log.gz 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55255.log 2024-09-17T11:00:37.166 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58782.log.gz 2024-09-17T11:00:37.167 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29224.log 2024-09-17T11:00:37.167 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67964.log.gz 2024-09-17T11:00:37.167 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61384.log 2024-09-17T11:00:37.167 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55255.log.gz 2024-09-17T11:00:37.167 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27515.log 2024-09-17T11:00:37.167 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29224.log.gz 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64624.log 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61384.log.gz 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27316.log 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27515.log.gz 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54169.log 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64624.log.gz 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53378.log 2024-09-17T11:00:37.168 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27316.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27316.log.gz 2024-09-17T11:00:37.169 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41184.log 2024-09-17T11:00:37.169 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54169.log.gz 2024-09-17T11:00:37.169 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32250.log 2024-09-17T11:00:37.169 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53378.log.gz 2024-09-17T11:00:37.169 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55830.log 2024-09-17T11:00:37.169 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41184.log.gz 2024-09-17T11:00:37.169 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28862.log 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32250.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32250.log.gz 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56298.log 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55830.log.gz 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65648.log 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28862.log.gz 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56298.log.gz 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67542.log 2024-09-17T11:00:37.170 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65648.log.gz 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.36694.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43470.log 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51133.log 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67542.log: gzip 23.7%/var/log/ceph/ceph-client.admin.43470.log: -5 -- replaced with /var/log/ceph/ceph-client.admin.67542.log.gz--verbose 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr:-- /var/log/ceph/ceph-client.admin.38309.log 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.43470.log.gz 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70204.log 2024-09-17T11:00:37.171 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51133.log.gz 2024-09-17T11:00:37.172 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40818.log 2024-09-17T11:00:37.172 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38309.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38309.log.gz 2024-09-17T11:00:37.172 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29311.log 2024-09-17T11:00:37.172 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70204.log.gz 2024-09-17T11:00:37.172 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55383.log 2024-09-17T11:00:37.172 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40818.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.40818.log.gz 2024-09-17T11:00:37.172 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29311.log.gz 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39655.log 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55383.log.gz 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49556.log 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63628.log 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39655.log.gz 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61093.log 2024-09-17T11:00:37.173 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49556.log.gz 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63785.log 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63628.log.gz 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26591.log 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61093.log.gz 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49125.log 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63785.log.gz 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35810.log 2024-09-17T11:00:37.174 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26591.log.gz 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30848.log 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49125.log.gz 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43122.log /var/log/ceph/ceph-client.admin.35810.log: 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35810.log.gz 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40171.log 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30848.log.gz 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59814.log 2024-09-17T11:00:37.175 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43122.log.gz 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63019.log 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40171.log.gz 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29804.log 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59814.log.gz 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37493.log 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63019.log.gz 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65012.log 2024-09-17T11:00:37.176 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29804.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.29804.log.gz 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33118.log 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37493.log.gz 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49728.log 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66465.log 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65012.log.gz 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33118.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33118.log.gz 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26892.log 2024-09-17T11:00:37.177 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49728.log.gz 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31192.log 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66938.log 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66465.log.gz 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26892.log.gz 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54105.log 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31192.log.gz 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57574.log 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66938.log.gz 2024-09-17T11:00:37.178 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57610.log 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65420.log 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54105.log.gz 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57574.log.gz 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57808.log 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57610.log.gz 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65420.log.gz 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55766.log 2024-09-17T11:00:37.179 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57808.log.gz 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64948.log 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43870.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63905.log /var/log/ceph/ceph-client.admin.55766.log: 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55766.log.gz 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45538.log 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64948.log.gz 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32625.log 2024-09-17T11:00:37.180 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63905.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.63905.log.gz 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61214.log 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45538.log.gz 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50302.log 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32625.log.gz 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53217.log 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61214.log.gz 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44568.log 2024-09-17T11:00:37.181 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50302.log.gz 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39171.log 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53217.log.gz 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46097.log 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44568.log.gz 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51369.log 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39171.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39171.log.gz 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27436.log 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46097.log.gz 2024-09-17T11:00:37.182 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29912.log 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51369.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.51369.log.gz 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27262.log 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27436.log.gz 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26827.log 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29912.log.gz 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50703.log 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27262.log.gz 2024-09-17T11:00:37.183 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63394.log 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26827.log.gz 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50703.log.gz 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67378.log 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63394.log: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.63394.log.gz 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68588.log 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47874.log 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr: 23.1% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67378.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.67378.log.gz 2024-09-17T11:00:37.184 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52072.log 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68588.log.gz 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48954.log 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47874.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47874.log.gz/var/log/ceph/ceph-client.admin.59040.log 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52072.log.gz 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62862.log 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48954.log.gz 2024-09-17T11:00:37.185 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64218.log 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59040.log.gz 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44589.log 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62862.log.gz 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54278.log 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64218.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29268.log 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64218.log.gz 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44589.log.gz 2024-09-17T11:00:37.186 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31055.log 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54278.log.gz 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40085.log 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29268.log.gz 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61620.log 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31055.log.gz 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32574.log 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40085.log.gz 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53804.log 2024-09-17T11:00:37.187 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61620.log.gz 2024-09-17T11:00:37.188 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39591.log 2024-09-17T11:00:37.188 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32574.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32574.log.gz 2024-09-17T11:00:37.188 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2024-09-17T11:00:37.188 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53804.log.gz 2024-09-17T11:00:37.188 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32370.log 2024-09-17T11:00:37.188 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48372.log 2024-09-17T11:00:37.188 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45255.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39591.log.gz 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35789.log 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32370.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32370.log.gz 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48372.log.gzgzip 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.38267.log 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35789.log.gz 2024-09-17T11:00:37.189 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35029.log 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38267.log: gzip 23.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.38267.log.gz--verbose 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:-- /var/log/ceph/ceph-client.admin.50470.log 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35029.log.gz 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62529.log 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2024-09-17T11:00:37.190 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64142.log 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50470.log.gz 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31268.log 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62529.log.gz 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46965.log 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64142.log.gz 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57326.log 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31268.log.gz 2024-09-17T11:00:37.191 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40522.log 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46965.log.gz 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43590.log 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57326.log.gz 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56110.log 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40522.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.40522.log.gz 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52051.log 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43590.log: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.43590.log.gz 2024-09-17T11:00:37.192 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39465.log 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56110.log.gz 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66400.log 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52051.log.gz 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39192.log 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39465.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.39465.log.gz 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54256.log 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69781.log 2024-09-17T11:00:37.193 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66400.log.gz 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0%/var/log/ceph/ceph-client.admin.54256.log: -- replaced with /var/log/ceph/ceph-client.admin.39192.log.gz 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54256.log.gz 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31311.log 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69781.log.gz 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58428.log 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43016.log: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2024-09-17T11:00:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61018.log 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31311.log.gz 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52518.log 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52497.log 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61018.log: 23.8% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61018.log.gz 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58428.log.gz 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58106.log 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52518.log.gz 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31137.log 2024-09-17T11:00:37.195 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52497.log.gz 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.58106.log: --verbose -- /var/log/ceph/ceph-client.admin.21131.log 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.58106.log.gz 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34909.log 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31137.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.31137.log.gz 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50811.log 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.21131.log: 27.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67501.log 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.21131.log.gz 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34909.log.gz 2024-09-17T11:00:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46681.log 2024-09-17T11:00:37.197 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50811.log.gz 2024-09-17T11:00:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27064.log 2024-09-17T11:00:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67501.log.gz 2024-09-17T11:00:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58954.log 2024-09-17T11:00:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46681.log.gz 2024-09-17T11:00:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64775.log 2024-09-17T11:00:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27064.log.gz 2024-09-17T11:00:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26913.log 2024-09-17T11:00:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58954.log.gz 2024-09-17T11:00:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64775.log.gz 2024-09-17T11:00:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58407.log 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66271.log 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26913.log.gz 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59320.log 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58407.log.gz 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41902.log 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66271.log.gz 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38940.log 2024-09-17T11:00:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59320.log.gz 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41902.log.gz 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54966.log 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38519.log 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36864.log 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38940.log.gz 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54966.log.gz 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69634.log 2024-09-17T11:00:37.202 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38519.log.gz 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36303.log 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36864.log.gz 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69634.log.gz 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32761.log 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36303.log.gz 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-09-17T11:00:37.203 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35469.log 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32761.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32761.log.gz 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68502.log 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35469.log.gz 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55153.log 2024-09-17T11:00:37.204 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68502.log.gz 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29569.log 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53890.log.gz 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55153.log.gz 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53653.log 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29569.log.gz 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.36660.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58868.log 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2024-09-17T11:00:37.205 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66078.log 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53653.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.53653.log.gz 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54299.log 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58868.log.gz 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33664.log 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66078.log.gz 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50725.log 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54299.log.gz 2024-09-17T11:00:37.206 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59685.log 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33664.log.gz 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61523.log 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50725.log.gz 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63745.log 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59685.log.gz 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28733.log 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61523.log.gz 2024-09-17T11:00:37.207 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55873.log 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63745.log.gz 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36966.log 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28733.log.gz 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53933.log 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55873.log.gz 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64667.log 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36966.log.gz 2024-09-17T11:00:37.208 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53933.log.gz 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30428.log 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64667.log.gz 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65215.log 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28238.log 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30428.log.gz 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31591.log 2024-09-17T11:00:37.209 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65215.log: /var/log/ceph/ceph-client.admin.28238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65215.log.gz 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37272.log 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28238.log.gz 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44048.log 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31591.log.gz 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27336.log 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37272.log.gz 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67604.log 2024-09-17T11:00:37.210 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44048.log.gz 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54148.log 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27336.log.gz 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31548.log 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67604.log.gz 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56982.log 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54148.log.gz 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38835.log 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31548.log.gz 2024-09-17T11:00:37.211 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49814.log 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56982.log.gz 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70312.log 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38835.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38835.log.gz 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49814.log: /var/log/ceph/ceph-client.admin.70312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49814.log.gz 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53546.log 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70312.log.gz 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43060.log 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-09-17T11:00:37.212 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60223.log 2024-09-17T11:00:37.213 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53546.log.gz 2024-09-17T11:00:37.213 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65970.log 2024-09-17T11:00:37.213 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43060.log: /var/log/ceph/ceph-client.admin.60223.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43060.log.gz-- 2024-09-17T11:00:37.213 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69204.log 2024-09-17T11:00:37.213 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60223.log.gz 2024-09-17T11:00:37.213 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36473.log 2024-09-17T11:00:37.213 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65970.log.gz 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29976.log 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69204.log.gz 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59427.log 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36473.log: /var/log/ceph/ceph-client.admin.29976.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36473.log.gz 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.40543.log 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29976.log.gz 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30557.log 2024-09-17T11:00:37.214 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59427.log.gz 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51685.log 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40543.log.gz 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68093.log 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30557.log.gz 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47694.log 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51685.log.gz 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51004.log 2024-09-17T11:00:37.215 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68093.log.gz 2024-09-17T11:00:37.216 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-09-17T11:00:37.216 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47694.log.gz 2024-09-17T11:00:37.216 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.51004.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53237.log 2024-09-17T11:00:37.216 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51004.log.gz 2024-09-17T11:00:37.216 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28582.log 2024-09-17T11:00:37.216 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-09-17T11:00:37.216 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54794.log 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53237.log.gz 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51922.log 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28582.log.gz 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27354.log 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54794.log.gz 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32387.log 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51922.log.gz 2024-09-17T11:00:37.217 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49599.log 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27354.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27354.log.gz 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34709.log 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36813.log 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2%/var/log/ceph/ceph-client.admin.49599.log: -- replaced with /var/log/ceph/ceph-client.admin.32387.log.gz 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49599.log.gz 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30234.log 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34709.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69161.log 2024-09-17T11:00:37.218 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34709.log.gz 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36813.log.gz 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54923.log 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30234.log.gz 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41571.log 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69161.log.gz 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46227.log 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54923.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62096.log 2024-09-17T11:00:37.219 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54923.log.gz 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41571.log.gz 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65257.log 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46227.log.gz 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60137.log 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62096.log.gz 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35329.log 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65257.log.gz 2024-09-17T11:00:37.220 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41377.log 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60137.log.gz 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60747.log 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35329.log.gz 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.41377.log: -- /var/log/ceph/ceph-client.admin.37510.log 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41377.log.gz 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65050.log 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60747.log.gz 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41055.log 2024-09-17T11:00:37.221 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37510.log.gz 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38078.log 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65050.log.gz 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56598.log 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41055.log.gz 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64120.log 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38078.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38078.log.gz 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30600.log 2024-09-17T11:00:37.222 INFO:teuthology.orchestra.run.smithi184.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.56598.log.gz 2024-09-17T11:00:37.223 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65440.log 2024-09-17T11:00:37.223 INFO:teuthology.orchestra.run.smithi184.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.64120.log.gz 2024-09-17T11:00:37.223 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53175.log 2024-09-17T11:00:37.223 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30600.log.gz 2024-09-17T11:00:37.223 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47503.log 2024-09-17T11:00:37.223 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65440.log: 26.5% -- replaced with /var/log/ceph/ceph-client.admin.65440.log.gz 2024-09-17T11:00:37.223 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.53175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53175.log.gz 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.50158.log 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47503.log.gz 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36235.log 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41442.log 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50158.log.gz 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47714.log 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36235.log.gz 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63375.log 2024-09-17T11:00:37.224 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41442.log.gz 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53976.log 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47714.log.gz 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56500.log 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63375.log.gz 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54708.log 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53976.log.gz 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.56500.log: --verbose -- /var/log/ceph/ceph-client.admin.46598.log 2024-09-17T11:00:37.225 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56500.log.gz 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58006.log 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54708.log.gz 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56874.log 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46598.log.gz 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62590.log 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58006.log.gz 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38057.log 2024-09-17T11:00:37.226 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56874.log.gz 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27244.log 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62590.log.gz 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36898.log 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38057.log: 23.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27591.log 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38057.log.gz 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27244.log.gz 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51836.log 2024-09-17T11:00:37.227 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36898.log.gz 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31913.log 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27591.log.gz 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64753.log 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51836.log.gz 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68330.log 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31913.log.gz 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26655.log 2024-09-17T11:00:37.228 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64753.log.gz 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28496.log 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68330.log.gz 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50575.log 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26655.log.gz 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28496.log.gz 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61195.log 2024-09-17T11:00:37.229 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50575.log.gz 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43512.log 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49189.log 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61195.log.gz 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29847.log 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43512.log.gz 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56402.log 2024-09-17T11:00:37.230 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49189.log.gz 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64198.log 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29847.log.gz 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47137.log 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56402.log.gz 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69505.log 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64198.log.gz 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54622.log 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47137.log.gz 2024-09-17T11:00:37.231 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.69505.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68631.log 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69505.log.gz 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69741.log 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70664.log 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54622.log.gz 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68631.log.gz 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27281.log 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69741.log.gz 2024-09-17T11:00:37.232 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64474.log 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70664.log.gz 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68373.log 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.27281.log.gz 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42343.log 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64474.log.gz 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47958.log 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68373.log.gz 2024-09-17T11:00:37.233 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62132.log 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42343.log.gz 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47958.log.gz 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54880.log 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62132.log.gz 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54428.log 2024-09-17T11:00:37.234 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54880.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54880.log.gz-5 2024-09-17T11:00:37.235 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.56520.log 2024-09-17T11:00:37.235 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33749.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2024-09-17T11:00:37.235 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.54428.log: --verbose -- /var/log/ceph/ceph-client.admin.58222.log 2024-09-17T11:00:37.235 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54428.log.gz 2024-09-17T11:00:37.235 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38709.log 2024-09-17T11:00:37.235 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56520.log.gz 2024-09-17T11:00:37.235 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40505.log 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58222.log.gz 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43850.log 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38709.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38709.log.gz 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43767.log 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40505.log.gz 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51857.log 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43850.log.gz 2024-09-17T11:00:37.236 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52617.log 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43767.log.gz 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31634.log 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64239.log 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51857.log.gz 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52617.log.gz 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39913.log 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31634.log.gz 2024-09-17T11:00:37.237 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43204.log 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64239.log.gz 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.39913.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38330.log 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39913.log.gz 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41270.log 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43204.log: 22.2% -- replaced with /var/log/ceph/ceph-client.admin.43204.log.gz 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58301.log 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38330.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38330.log.gz 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64710.log 2024-09-17T11:00:37.238 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41270.log.gz 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36881.log 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58301.log.gz 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32352.log 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64710.log.gz 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42025.log 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36881.log.gz 2024-09-17T11:00:37.239 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32352.log.gz 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41737.log 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42025.log.gz 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64581.log 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47594.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32506.log 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41737.log.gz 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68265.log 2024-09-17T11:00:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64581.log.gz 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63471.log 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32506.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32506.log.gz 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66551.log 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68265.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.68265.log.gz-5 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.39423.log 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63471.log.gz 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46476.log 2024-09-17T11:00:37.241 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66551.log.gz 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66959.log 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39423.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49685.log 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46476.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46476.log.gz-5 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.45925.log 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66959.log.gz 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28475.log 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49685.log.gz 2024-09-17T11:00:37.242 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37529.log 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45925.log.gz 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57390.log 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28475.log.gz 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66873.log 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37529.log: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.37529.log.gz 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61072.log 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57390.log.gz 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36405.log 2024-09-17T11:00:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66873.log.gz 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46140.log 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61072.log.gz 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32318.log 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36405.log.gz 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67745.log 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46140.log.gz 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50832.log 2024-09-17T11:00:37.244 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32318.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32318.log.gz 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39003.log 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67745.log.gz 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27913.log 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50832.log.gz 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29676.log 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39003.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39003.log.gz 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45688.log 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27913.log.gz 2024-09-17T11:00:37.245 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45233.log 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29676.log.gz 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45688.log.gz 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30062.log 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45233.log.gz 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56896.log 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51348.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57540.log 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30062.log.gz 2024-09-17T11:00:37.246 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40904.log 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56896.log.gz 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52330.log 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57540.log.gz 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.40904.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67805.log 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40904.log.gz 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33288.log 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52330.log.gz 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36014.log 2024-09-17T11:00:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36609.log 11.1% 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67805.log.gz 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33288.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33288.log.gz 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.36014.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35049.log 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36014.log.gz 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36609.log.gz 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29144.log 2024-09-17T11:00:37.248 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67845.log 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35049.log.gz 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29144.log: 26.5% -- replaced with /var/log/ceph/ceph-client.admin.29144.log.gz 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58997.log 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40676.log 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67845.log.gz 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32438.log 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58997.log.gz 2024-09-17T11:00:37.249 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33543.log 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40676.log.gz 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33441.log 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32438.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32438.log.gz 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33322.log 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47288.log 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33543.log.gz 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59642.log 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33441.log.gz 2024-09-17T11:00:37.250 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33322.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33322.log.gz 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55809.log 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47288.log.gz 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66615.log 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59642.log.gz 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55809.log.gz 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48889.log 2024-09-17T11:00:37.251 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66615.log.gz 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61363.log 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39339.log 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.48889.log.gz 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63645.log 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61363.log.gz 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-09-17T11:00:37.252 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39339.log: 22.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53739.log 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63645.log: -- replaced with /var/log/ceph/ceph-client.admin.39339.log.gz 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63645.log.gz 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67986.log 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56002.log 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56700.log 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.53739.log.gz 2024-09-17T11:00:37.253 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67986.log: /var/log/ceph/ceph-client.admin.56002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67986.log.gz 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64101.log 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56002.log.gz 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56853.log 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56700.log.gz 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42085.log 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64101.log.gz 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55594.log 2024-09-17T11:00:37.254 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56853.log.gz 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58027.log 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42085.log: 17.8% -- replaced with /var/log/ceph/ceph-client.admin.42085.log.gz 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42064.log 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55594.log.gz 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39762.log 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58027.log.gz 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66293.log 2024-09-17T11:00:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42064.log.gz 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64882.log 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39762.log.gz 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34409.log 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66293.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34849.log 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66293.log.gz 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64882.log.gz 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52158.log 2024-09-17T11:00:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34409.log.gz 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26202.log 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34849.log.gz 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63685.log /var/log/ceph/ceph-client.admin.52158.log: 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52158.log.gz 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52540.log 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26202.log.gz 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54212.log 2024-09-17T11:00:37.257 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63685.log.gz 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52967.log 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52540.log.gz 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38793.log 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54212.log.gz 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52741.log 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52967.log.gz 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.38793.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39805.log 2024-09-17T11:00:37.258 INFO:teuthology.orchestra.run.smithi184.stderr: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.38793.log.gz 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62690.log 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52741.log.gz 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.39805.log: --verbose -- /var/log/ceph/ceph-client.admin.61817.log 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39805.log.gz 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29890.log 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62690.log.gz 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33509.log 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61817.log.gz 2024-09-17T11:00:37.259 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55423.log 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29890.log.gz 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26254.log 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33509.log: gzip -5 1.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33509.log.gz/var/log/ceph/ceph-client.admin.30471.log 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27434.log 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55423.log.gz 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26254.log.gz 2024-09-17T11:00:37.260 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28410.log 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30471.log.gz 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32812.log 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27434.log.gz 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69849.log 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28410.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28410.log.gz 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.61273.log 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32812.log: gzip 2.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.32812.log.gz--verbose 2024-09-17T11:00:37.261 INFO:teuthology.orchestra.run.smithi184.stderr:-- /var/log/ceph/ceph-client.admin.61600.log 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69849.log.gz 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55701.log 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61273.log.gz 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32020.log 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61600.log.gz 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48227.log 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55701.log.gz 2024-09-17T11:00:37.262 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49361.log 2024-09-17T11:00:37.263 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32020.log.gz 2024-09-17T11:00:37.263 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59707.log 2024-09-17T11:00:37.263 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48227.log.gz 2024-09-17T11:00:37.263 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68780.log 2024-09-17T11:00:37.263 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49361.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49361.log.gz-5 2024-09-17T11:00:37.263 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.28026.log 2024-09-17T11:00:37.263 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59707.log.gz 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32897.log 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68780.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.68780.log.gz 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37442.log 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28026.log.gz 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33016.log 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32897.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32897.log.gz 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55047.log 2024-09-17T11:00:37.264 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37442.log.gz 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68716.log 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33016.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33016.log.gz 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62466.log 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55047.log.gz 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68115.log 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68716.log.gz 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53398.log 2024-09-17T11:00:37.265 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62466.log.gz 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55446.log 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68115.log.gz 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56810.log 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53398.log.gz 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47817.log 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55446.log.gz 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38393.log 2024-09-17T11:00:37.266 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56810.log.gz 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57629.log 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64926.log 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47817.log.gz 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38393.log: /var/log/ceph/ceph-client.admin.57629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55067.log 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38393.log.gz 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57629.log.gz 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37255.log 2024-09-17T11:00:37.267 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64926.log.gz 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69032.log 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55067.log.gz 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66895.log 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37255.log.gz 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46528.log 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69032.log.gz 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67174.log 2024-09-17T11:00:37.268 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66895.log.gz 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40364.log 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46528.log.gz 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62406.log 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67174.log.gz 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37574.log 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40364.log.gz 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57650.log 2024-09-17T11:00:37.269 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62406.log.gz 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32421.log 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37574.log: gzip 23.8% -- replaced with /var/log/ceph/ceph-client.admin.37574.log.gz-5 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.35269.log 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57650.log.gz 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40639.log 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32421.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32421.log.gz 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36439.log 2024-09-17T11:00:37.270 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35269.log.gz 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55089.log 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40639.log.gz 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36830.log 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43986.log 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0%/var/log/ceph/ceph-client.admin.55089.log: -- replaced with /var/log/ceph/ceph-client.admin.36439.log.gz 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.36830.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29107.log 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55089.log.gz 2024-09-17T11:00:37.271 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36830.log.gz 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43986.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.43986.log.gz 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60420.log 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53761.log 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29107.log.gz 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57930.log 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60420.log.gz 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60781.log 2024-09-17T11:00:37.272 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53761.log.gz 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30041.log 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57930.log.gz 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.60781.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43449.log 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60781.log.gz 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28964.log 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30041.log.gz 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50534.log 2024-09-17T11:00:37.273 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43449.log.gz 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28964.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28964.log.gz-5 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.45126.log 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50534.log.gz 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35429.log 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57750.log 2024-09-17T11:00:37.274 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45126.log.gz 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35429.log: /var/log/ceph/ceph-client.admin.69483.log 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35429.log.gz 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65627.log 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57750.log.gz 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67825.log 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69483.log.gz 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37102.log 2024-09-17T11:00:37.275 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65627.log.gz 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67195.log 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67825.log.gz 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56174.log 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60727.log 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37102.log.gz 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67195.log.gz 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32472.log 2024-09-17T11:00:37.276 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56174.log.gz 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48719.log 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60727.log.gz 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35589.log 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32267.log 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32472.log.gz 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48719.log.gz 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36541.log 2024-09-17T11:00:37.277 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35589.log.gz 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47546.log 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32267.log: gzip 1.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.32267.log.gz-- 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60029.log 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36541.log.gz 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47546.log.gz 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60029.log: /var/log/ceph/ceph-client.admin.68287.log 2024-09-17T11:00:37.278 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60029.log.gz 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48288.log 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gz 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53567.log 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41985.log 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68287.log.gz 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48288.log.gz 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57089.log 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53567.log.gz 2024-09-17T11:00:37.279 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41985.log.gz 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30903.log 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57089.log.gz 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38120.log 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63300.log 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30903.log.gz 2024-09-17T11:00:37.280 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52801.log 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38120.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38120.log.gz 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50029.log 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63300.log.gz 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48412.log 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52801.log.gz 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.50029.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28797.log 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50029.log.gz 2024-09-17T11:00:37.281 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34249.log 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48412.log.gz 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69096.log 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28797.log.gz 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30578.log 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34249.log.gz 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69096.log.gz 2024-09-17T11:00:37.282 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38814.log 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30578.log.gz 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30793.log 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36983.log 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38814.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38814.log.gz 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44954.log 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30793.log.gz 2024-09-17T11:00:37.283 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47202.log 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36983.log.gz 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44954.log.gz 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35389.log 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60180.log 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47202.log.gz 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30105.log 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35389.log.gz 2024-09-17T11:00:37.284 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47481.log 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60180.log.gz 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51664.log 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30105.log.gz 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60651.log 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47481.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64517.log 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51664.log: /var/log/ceph/ceph-client.admin.60651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51664.log.gz 2024-09-17T11:00:37.285 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44389.log 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60651.log.gz 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.64517.log: --verbose -- /var/log/ceph/ceph-client.admin.53259.log 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64517.log.gz 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31955.log 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44389.log.gz 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70041.log 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.53259.log.gz 2024-09-17T11:00:37.286 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30664.log 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31955.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44327.log 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70041.log: -- replaced with /var/log/ceph/ceph-client.admin.31955.log.gz 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70041.log.gz 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48038.log 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30664.log.gz 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58739.log 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44327.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.44327.log.gz 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50983.log 2024-09-17T11:00:37.287 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48038.log.gz 2024-09-17T11:00:37.288 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-09-17T11:00:37.288 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58739.log.gz 2024-09-17T11:00:37.288 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34229.log 2024-09-17T11:00:37.288 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50983.log.gz 2024-09-17T11:00:37.288 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31158.log 2024-09-17T11:00:37.288 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44410.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-09-17T11:00:37.288 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34229.log.gz 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66314.log 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31158.log.gz 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31741.log 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58261.log 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2024-09-17T11:00:37.289 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66314.log.gz 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31741.log.gz 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44548.log 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58261.log.gz 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48496.log 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62962.log 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67419.log 23.3% 2024-09-17T11:00:37.290 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48496.log: /var/log/ceph/ceph-client.admin.62962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52094.log 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.48496.log.gz 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62962.log.gz 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66744.log 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67419.log.gz 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61797.log 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52094.log.gz 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59750.log 2024-09-17T11:00:37.291 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66744.log.gz 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61114.log 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61797.log.gz 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59750.log.gz 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69548.log 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61114.log.gz 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47674.log 2024-09-17T11:00:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42384.log: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40466.log 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69548.log.gz 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28071.log 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47674.log.gz 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60158.log 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40466.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64839.log 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40466.log.gz 2024-09-17T11:00:37.293 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28071.log: 0.0%/var/log/ceph/ceph-client.admin.60158.log: -- replaced with /var/log/ceph/ceph-client.admin.28071.log.gz 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47634.log 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60158.log.gz 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40696.log 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64839.log.gz 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26999.log 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47634.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.47634.log.gz 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.42181.log 2024-09-17T11:00:37.294 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40696.log.gz 2024-09-17T11:00:37.295 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41119.log 2024-09-17T11:00:37.295 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26999.log.gz 2024-09-17T11:00:37.295 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30127.log 2024-09-17T11:00:37.295 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42181.log.gz 2024-09-17T11:00:37.295 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37374.log 2024-09-17T11:00:37.295 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41119.log.gz 2024-09-17T11:00:37.295 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32608.log 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30127.log.gz 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30965.log 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37374.log.gz 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41485.log 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32608.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32608.log.gz 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30965.log.gz 2024-09-17T11:00:37.296 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31019.log 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31806.log 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41485.log.gz 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54729.log 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31019.log.gz 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42976.log 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41882.log 2024-09-17T11:00:37.297 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31806.log.gz 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54729.log.gz 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49943.log 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42976.log.gz 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40278.log 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41882.log.gz 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41098.log 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48868.log 2024-09-17T11:00:37.298 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40278.log.gz 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59492.log 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41098.log.gz 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48996.log 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48868.log.gz 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56045.log 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59492.log.gz 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29042.log 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48996.log.gz 2024-09-17T11:00:37.299 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31720.log 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56045.log.gz 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39934.log 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29042.log: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.29042.log.gz 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30019.log 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31720.log.gz 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38456.log 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39934.log.gz 2024-09-17T11:00:37.300 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30750.log 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30019.log.gz 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40562.log 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61252.log 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30750.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38456.log.gz 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30750.log.gz 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45426.log 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40562.log.gz 2024-09-17T11:00:37.301 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61252.log.gz 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53632.log 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45426.log.gz 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63608.log 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65755.log 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53632.log.gz 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30148.log 2024-09-17T11:00:37.302 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63608.log.gz 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63705.log 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65755.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.65755.log.gz 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64991.log 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30148.log.gz 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63705.log.gz 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62366.log 2024-09-17T11:00:37.303 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64991.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29182.log 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64991.log.gz 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54772.log 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62366.log.gz 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37068.log 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29182.log.gz 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67563.log 2024-09-17T11:00:37.304 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54772.log.gz 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50179.log 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37068.log.gz 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40620.log 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.67563.log.gz 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60632.log 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50179.log.gz 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25532.log 2024-09-17T11:00:37.305 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40620.log.gz 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43907.log 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60632.log.gz 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34809.log 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25532.log.gz 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67923.log 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43907.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.43907.log.gz 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2024-09-17T11:00:37.306 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34809.log.gz 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46388.log 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67923.log.gz 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57347.log 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53318.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gz 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.65460.log 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46388.log.gz 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25835.log 2024-09-17T11:00:37.307 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57347.log.gz 2024-09-17T11:00:37.308 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2024-09-17T11:00:37.308 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65460.log.gz 2024-09-17T11:00:37.308 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68007.log 2024-09-17T11:00:37.308 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25835.log.gz 2024-09-17T11:00:37.308 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35609.log 2024-09-17T11:00:37.308 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40063.log 2024-09-17T11:00:37.308 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68007.log.gz 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48308.log 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35609.log.gz 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34949.log 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40063.log.gz 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70637.log 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48308.log.gz 2024-09-17T11:00:37.309 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62825.log 2024-09-17T11:00:37.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34949.log.gz 2024-09-17T11:00:37.310 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34389.log 2024-09-17T11:00:37.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46494.log 2024-09-17T11:00:37.310 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70637.log.gz 2024-09-17T11:00:37.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62825.log.gz 2024-09-17T11:00:37.310 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49706.log 2024-09-17T11:00:37.310 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34389.log.gz 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57412.log 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46494.log.gz 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59341.log 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49706.log.gz 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59879.log 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57412.log.gz 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64007.log 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59341.log.gz 2024-09-17T11:00:37.311 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47734.log 2024-09-17T11:00:37.312 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59879.log.gz 2024-09-17T11:00:37.312 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T11:00:37.312 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64007.log.gz 2024-09-17T11:00:37.312 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-09-17T11:00:37.312 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47734.log.gz 2024-09-17T11:00:37.312 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62806.log 2024-09-17T11:00:37.312 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64495.log 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62806.log.gz 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52223.log 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.64495.log.gz 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29698.log 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52223.log.gz 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53610.log 2024-09-17T11:00:37.313 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38646.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50940.log 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29698.log.gz 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66852.log 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53610.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.53610.log.gz 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47073.log 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50940.log.gz 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37136.log 2024-09-17T11:00:37.314 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66852.log.gz 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63336.log 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47073.log.gz 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25755.log 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37136.log.gz 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30686.log 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63336.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55214.log 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.315 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25755.log.gz 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59621.log 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30686.log.gz 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68695.log 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55214.log.gz 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32523.log 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68050.log 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59621.log.gz 2024-09-17T11:00:37.316 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68695.log: /var/log/ceph/ceph-client.admin.32523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68695.log.gz 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36252.log 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32523.log.gz 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33169.log 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68050.log.gz 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36252.log.gz 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67312.log 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70068.log 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33169.log.gz 2024-09-17T11:00:37.317 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25620.log 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67312.log.gz 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62925.log 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70068.log.gz 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55744.log 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25620.log.gz 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43391.log 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62925.log.gz 2024-09-17T11:00:37.318 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40407.log 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55744.log.gz 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64180.log 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.43391.log.gz 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40407.log.gz 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61920.log 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35249.log 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64180.log.gz 2024-09-17T11:00:37.319 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61920.log: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.61920.log.gz 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51621.log 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35249.log.gz 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48517.log 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51621.log.gz 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30213.log 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-09-17T11:00:37.320 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48517.log: 23.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26176.log 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30213.log: -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48517.log.gz 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30213.log.gz 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69075.log 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54493.log 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26176.log.gz 2024-09-17T11:00:37.321 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39827.log 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69075.log.gz 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26956.log 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54493.log.gz 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39827.log.gz 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60534.log 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26956.log.gz 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39507.log 2024-09-17T11:00:37.322 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39024.log 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60534.log.gz 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39507.log: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.39507.log.gz 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32182.log 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39024.log: 23.8% -- replaced with /var/log/ceph/ceph-client.admin.39024.log.gz 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47567.log 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31977.log 2024-09-17T11:00:37.323 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32182.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32182.log.gz 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47567.log.gz 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41463.log 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31977.log: 28.9% -- replaced with /var/log/ceph/ceph-client.admin.31977.log.gz 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59255.log 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39066.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27495.log 2024-09-17T11:00:37.324 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41463.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40106.log 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41463.log.gz 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59255.log.gz 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.27495.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32540.log 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27495.log.gz 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44090.log 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40106.log.gz 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32540.log.gz 2024-09-17T11:00:37.325 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45104.log 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44090.log.gz 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35009.log 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29090.log 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45104.log: /var/log/ceph/ceph-client.admin.35009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45104.log.gz 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35009.log.gz 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65090.log 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62229.log 2024-09-17T11:00:37.326 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29090.log: /var/log/ceph/ceph-client.admin.65090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29090.log.gz 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65090.log.gz 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31934.log 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26806.log 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34789.log 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31934.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62229.log.gz 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31934.log.gz 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26806.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33033.log 2024-09-17T11:00:37.327 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26806.log.gz 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34189.log 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34789.log: gzip /var/log/ceph/ceph-client.admin.33033.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30191.log 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34789.log.gz 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33033.log.gz 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44489.log 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34189.log.gz 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30191.log.gz 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35089.log 2024-09-17T11:00:37.328 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65399.log 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59406.log 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35089.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44489.log.gz 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35089.log.gz 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.65399.log.gz 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59406.log.gz 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56196.log 2024-09-17T11:00:37.329 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60072.log 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63159.log 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56196.log.gz 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60072.log.gz 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65586.log 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68480.log 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63159.log.gz 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32744.log 2024-09-17T11:00:37.330 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65586.log.gz 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68480.log.gz 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25834.log 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32744.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32744.log.gz 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35844.log 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45559.log 2024-09-17T11:00:37.331 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25834.log.gz 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58048.log 0.0% 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35844.log.gz 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45559.log.gz 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45796.log 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25990.log 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58048.log.gz 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68989.log 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45796.log.gz 2024-09-17T11:00:37.332 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25990.log.gz 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44997.log 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51327.log 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68989.log.gz 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44997.log.gz 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35309.log 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51327.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59836.log 2024-09-17T11:00:37.333 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51327.log.gz 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32948.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35309.log.gz 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33390.log 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57869.log 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59836.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38751.log 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59836.log.gz 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33390.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33390.log.gz 2024-09-17T11:00:37.334 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61035.log 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57869.log.gz 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64603.log 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38751.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38751.log.gz 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59384.log 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61035.log.gz 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55916.log 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64603.log.gz 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65992.log 2024-09-17T11:00:37.335 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59384.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29397.log 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59384.log.gz 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55916.log.gz 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33785.log 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65992.log.gz 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63825.log 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29397.log.gz 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62487.log 2024-09-17T11:00:37.336 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39255.log 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.33785.log.gz 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63825.log.gz 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36575.log 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62487.log.gz 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42404.log 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39255.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.39255.log.gz 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41205.log 2024-09-17T11:00:37.337 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36575.log.gz 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48677.log 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42404.log: 57.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45190.log 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41205.log: -- replaced with /var/log/ceph/ceph-client.admin.42404.log.gz 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41205.log.gz 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46317.log 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48677.log.gz 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30535.log 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45190.log.gz 2024-09-17T11:00:37.338 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28776.log 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46317.log.gz 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59857.log 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30535.log.gz 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55340.log 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28776.log.gz 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58512.log 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59857.log.gz 2024-09-17T11:00:37.339 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53338.log 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55340.log.gz 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58512.log.gz 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41943.log 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53338.log.gz 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27743.log 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41943.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.41943.log.gz 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33732.log 2024-09-17T11:00:37.340 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27743.log.gz 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53135.log 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36507.log 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33732.log.gz 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67024.log 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53135.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53135.log.gz-5 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.50789.log 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36507.log.gz 2024-09-17T11:00:37.341 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44310.log 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67024.log.gz 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26483.log 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50789.log.gz 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.44310.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64905.log 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44310.log.gz 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25913.log 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26483.log.gz 2024-09-17T11:00:37.342 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33628.log 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64905.log.gz 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36677.log 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25913.log.gz 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35409.log 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33628.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33628.log.gz 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46424.log 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36677.log.gz 2024-09-17T11:00:37.343 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57154.log 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35409.log.gz 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50007.log 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46424.log.gz 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69354.log 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57154.log.gz 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.50007.log: --verbose -- /var/log/ceph/ceph-client.admin.70231.log 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50007.log.gz 2024-09-17T11:00:37.344 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57729.log 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69354.log.gz 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57111.log 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70231.log.gz 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41716.log 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57729.log.gz 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60051.log 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57111.log.gz 2024-09-17T11:00:37.345 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70475.log 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41716.log.gz 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47008.log 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60051.log.gz 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69290.log 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70475.log.gz 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56217.log 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47008.log.gz 2024-09-17T11:00:37.346 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.69290.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27150.log 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69290.log.gz 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68244.log 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56217.log.gz 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48204.log 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27150.log.gz 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70258.log 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68244.log.gz 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66572.log 2024-09-17T11:00:37.347 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48204.log.gz 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28539.log 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70258.log.gz/var/log/ceph/ceph-client.admin.66572.log: 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50875.log 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66572.log.gz 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55508.log 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28539.log: /var/log/ceph/ceph-client.admin.50875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28539.log.gz 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48615.log 2024-09-17T11:00:37.348 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50875.log.gz 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51026.log 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55508.log.gz 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.48615.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68652.log 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48615.log.gz 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65669.log 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51026.log.gz 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43672.log 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68652.log.gz 2024-09-17T11:00:37.349 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68394.log 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65669.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.65669.log.gz 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39234.log 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43672.log.gz 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68394.log.gz 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26044.log 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54019.log 2024-09-17T11:00:37.350 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39234.log.gz 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42202.log 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26044.log.gz 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65884.log 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54019.log.gz 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.42202.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32880.log 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.42202.log.gz 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38625.log 2024-09-17T11:00:37.351 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65884.log.gz 2024-09-17T11:00:37.352 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41291.log 2024-09-17T11:00:37.352 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32880.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32880.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70176.log 2024-09-17T11:00:37.352 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.352 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38625.log.gz 2024-09-17T11:00:37.352 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.41291.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36337.log 2024-09-17T11:00:37.352 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41291.log.gz 2024-09-17T11:00:37.352 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28905.log 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70176.log.gz 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63453.log 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36337.log.gz 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59965.log 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28905.log.gz 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62609.log 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63453.log: 0.0%/var/log/ceph/ceph-client.admin.59965.log: -- replaced with /var/log/ceph/ceph-client.admin.63453.log.gz 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25836.log 2024-09-17T11:00:37.353 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59965.log.gz 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65192.log 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62609.log.gz 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46282.log 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25836.log.gz 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67355.log 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65192.log.gz 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66357.log 2024-09-17T11:00:37.354 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46282.log.gz 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67355.log.gz 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64280.log 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66637.log 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66357.log.gz 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32131.log 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64280.log.gz 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66637.log: /var/log/ceph/ceph-client.admin.28051.log 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66637.log.gz 2024-09-17T11:00:37.355 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30449.log 2024-09-17T11:00:37.356 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32131.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32131.log.gz 2024-09-17T11:00:37.356 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29022.log 2024-09-17T11:00:37.356 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28051.log.gz 2024-09-17T11:00:37.356 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45882.log 2024-09-17T11:00:37.356 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35229.log 2024-09-17T11:00:37.356 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30449.log.gz 2024-09-17T11:00:37.356 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29022.log.gz 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58449.log 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51642.log 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45882.log.gz 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35229.log: /var/log/ceph/ceph-client.admin.58449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35229.log.gz 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61176.log 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58449.log.gz 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38582.log 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51642.log: gzip /var/log/ceph/ceph-client.admin.61176.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2024-09-17T11:00:37.357 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51642.log.gz 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61176.log.gz 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59169.log 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38582.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41695.log 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52377.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33407.log 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59169.log: -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59169.log.gz 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46545.log 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41695.log.gz 2024-09-17T11:00:37.358 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28217.log 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46545.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33407.log.gz 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46545.log.gz 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52843.log 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28217.log.gz 2024-09-17T11:00:37.359 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52843.log: /var/log/ceph/ceph-client.admin.33424.log 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52843.log.gz 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69815.log 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59234.log 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33424.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33424.log.gz 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26720.log 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69815.log.gz 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53419.log 2024-09-17T11:00:37.360 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59234.log.gz 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26720.log.gz 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30621.log 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53419.log.gz 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34129.log 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35369.log 2024-09-17T11:00:37.361 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33969.log 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30621.log.gz 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62508.log 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34129.log.gz 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35369.log.gz 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.33969.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49964.log 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33969.log.gz 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62055.log 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62508.log.gz 2024-09-17T11:00:37.362 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49964.log.gz 2024-09-17T11:00:37.363 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58655.log 2024-09-17T11:00:37.363 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31763.log 2024-09-17T11:00:37.363 INFO:teuthology.orchestra.run.smithi184.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.62055.log.gz 2024-09-17T11:00:37.363 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58655.log.gz 2024-09-17T11:00:37.363 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2024-09-17T11:00:37.363 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26462.log 2024-09-17T11:00:37.363 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31763.log.gz 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31074.log 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26741.log 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26462.log.gz 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29655.log 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31074.log.gz 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69762.log 2024-09-17T11:00:37.364 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26741.log.gz 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28153.log 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29655.log.gz 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32829.log 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69762.log.gz 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33929.log 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28153.log.gz 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60904.log 2024-09-17T11:00:37.365 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32829.log.gz 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35709.log 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33929.log.gz 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42363.log 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60904.log.gz 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35709.log.gz 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63354.log 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70149.log 2024-09-17T11:00:37.366 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42363.log.gz 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65712.log 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63354.log.gz 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66013.log 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70149.log.gz 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65712.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.65712.log.gz 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68158.log 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56767.log 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66013.log.gz 2024-09-17T11:00:37.367 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.68158.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68158.log.gz 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.56767.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34569.log 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56767.log.gz 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35629.log 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44248.log: 31.8% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64818.log 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34569.log.gz 2024-09-17T11:00:37.368 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34969.log 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35629.log.gz 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65565.log 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64818.log.gz 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60802.log 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68437.log 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34969.log.gz 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65565.log.gz 2024-09-17T11:00:37.369 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47797.log 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60802.log.gz 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38246.log 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26634.log 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68437.log.gz 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63079.log 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.38246.log.gz 2024-09-17T11:00:37.370 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34309.log 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26634.log.gz 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68947.log 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63079.log.gz 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34309.log.gz 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33611.log 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68947.log: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.68947.log.gz 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33809.log 2024-09-17T11:00:37.371 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57283.log 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33611.log.gz 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66809.log 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33809.log.gz 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38667.log 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57283.log.gz 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51728.log 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66809.log.gz 2024-09-17T11:00:37.372 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42105.log 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38667.log: 23.1% -- replaced with /var/log/ceph/ceph-client.admin.38667.log.gz 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42748.log 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51728.log.gz 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36133.log 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42105.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.42105.log.gz 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.42748.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34349.log 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42748.log.gz 2024-09-17T11:00:37.373 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33254.log 2024-09-17T11:00:37.374 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36133.log.gz 2024-09-17T11:00:37.374 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61697.log 2024-09-17T11:00:37.374 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34349.log.gz 2024-09-17T11:00:37.374 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42894.log /var/log/ceph/ceph-client.admin.33254.log: 2024-09-17T11:00:37.374 INFO:teuthology.orchestra.run.smithi184.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33254.log.gz 2024-09-17T11:00:37.374 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35946.log 2024-09-17T11:00:37.374 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61697.log.gz 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45645.log 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42894.log.gz 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35946.log.gz 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45645.log: /var/log/ceph/ceph-client.admin.65278.log 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45645.log.gz 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61640.log 2024-09-17T11:00:37.375 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51262.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz-5 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.53696.log 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65278.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37204.log 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65278.log.gz 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61640.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.61640.log.gz 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.48825.log 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53696.log.gz 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33373.log 2024-09-17T11:00:37.376 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37204.log.gz 2024-09-17T11:00:37.377 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55615.log 2024-09-17T11:00:37.377 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48825.log.gz 2024-09-17T11:00:37.377 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25749.log 2024-09-17T11:00:37.377 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33373.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33373.log.gz 2024-09-17T11:00:37.377 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.55615.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42143.log 2024-09-17T11:00:37.377 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55615.log.gz 2024-09-17T11:00:37.377 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37868.log 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25749.log.gz 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56365.log 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42143.log.gz 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69832.log 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37868.log.gz 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44268.log 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56365.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52137.log 2024-09-17T11:00:37.378 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69832.log: -- replaced with /var/log/ceph/ceph-client.admin.56365.log.gz 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr: 11.8% -- replaced with /var/log/ceph/ceph-client.admin.69832.log.gz 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62269.log 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27705.log 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44268.log.gz 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52137.log: gzip /var/log/ceph/ceph-client.admin.62269.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43412.log 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52137.log.gz 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62269.log.gz 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.27705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50596.log 2024-09-17T11:00:37.379 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27705.log.gz 2024-09-17T11:00:37.380 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60610.log 2024-09-17T11:00:37.380 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43412.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43412.log.gz 2024-09-17T11:00:37.380 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59771.log 2024-09-17T11:00:37.380 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50596.log.gz 2024-09-17T11:00:37.380 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46701.log 2024-09-17T11:00:37.380 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60610.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60610.log.gz 2024-09-17T11:00:37.380 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.67725.log 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59771.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31175.log 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46701.log: -- replaced with /var/log/ceph/ceph-client.admin.59771.log.gz 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46701.log.gz 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67725.log.gz 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60460.log 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2024-09-17T11:00:37.381 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44696.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.31175.log.gz 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51557.log 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60460.log.gz 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69225.log 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51557.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51557.log.gz 2024-09-17T11:00:37.382 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.46742.log 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46204.log 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69225.log.gz 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47094.log 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46742.log.gz 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62386.log 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46204.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59083.log 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47094.log: -- replaced with /var/log/ceph/ceph-client.admin.46204.log.gz 2024-09-17T11:00:37.383 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47094.log.gz 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50346.log 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62386.log.gz 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39570.log 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58825.log 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59083.log.gz 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr: 29.2% -- replaced with /var/log/ceph/ceph-client.admin.50346.log.gz 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61583.log 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39570.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.39570.log.gz 2024-09-17T11:00:37.384 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.58825.log: -- /var/log/ceph/ceph-client.admin.47116.log 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58825.log.gz 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32863.log 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61583.log.gz 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37973.log 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67521.log 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53997.log 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32863.log.gz 2024-09-17T11:00:37.385 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44803.log 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.37973.log.gz 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54815.log 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.67521.log.gz 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53997.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53997.log.gz-5 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr:--verbose -- /var/log/ceph/ceph-client.admin.45817.log 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44803.log: gzip /var/log/ceph/ceph-client.admin.54815.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38183.log 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44803.log.gz 2024-09-17T11:00:37.386 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54815.log.gz 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47854.log 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45817.log.gz 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41799.log 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38183.log.gz 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47854.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47854.log.gz 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.37616.log 2024-09-17T11:00:37.387 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41799.log.gz 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69677.log 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41657.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40192.log 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39612.log 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.37616.log.gz 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69677.log.gz 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40192.log.gz 2024-09-17T11:00:37.388 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38877.log 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60591.log 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33050.log 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39612.log.gz 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38877.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.38877.log.gz 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66916.log 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60591.log.gz 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34869.log 2024-09-17T11:00:37.389 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40214.log 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66916.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33050.log.gz 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66916.log.gz 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29740.log 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34869.log.gz 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64259.log 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40214.log.gz 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52679.log 2024-09-17T11:00:37.390 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29740.log.gz 2024-09-17T11:00:37.391 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62306.log 2024-09-17T11:00:37.391 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64259.log.gz 2024-09-17T11:00:37.391 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30945.log 2024-09-17T11:00:37.391 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52679.log.gz 2024-09-17T11:00:37.391 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67252.log 2024-09-17T11:00:37.391 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62306.log.gz 2024-09-17T11:00:37.391 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.30945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30945.log.gz 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67252.log.gz 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59599.log 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62765.log 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-09-17T11:00:37.392 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40257.log 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59599.log.gz 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47460.log 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62765.log.gz 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46032.log 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40257.log: /var/log/ceph/ceph-client.admin.47460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54471.log 0.0% 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40257.log.gz 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47460.log.gz 2024-09-17T11:00:37.393 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52721.log 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46032.log.gz 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55276.log 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54471.log.gz 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50854.log 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52721.log.gz 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56939.log 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55276.log.gz 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70556.log 2024-09-17T11:00:37.394 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65906.log 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0%/var/log/ceph/ceph-client.admin.56939.log: -- replaced with /var/log/ceph/ceph-client.admin.50854.log.gz 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56939.log.gz 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38162.log 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70556.log.gz 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41313.log 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.65906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65906.log.gz 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62671.log 2024-09-17T11:00:37.395 INFO:teuthology.orchestra.run.smithi184.stderr: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.38162.log.gz 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.41313.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42996.log 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41313.log.gz 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31462.log 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.62671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62671.log.gz 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34829.log 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42996.log.gz 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63435.log 2024-09-17T11:00:37.396 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31462.log.gz 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64969.log 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34829.log.gz 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63435.log.gz 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46944.log 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64969.log.gz 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56318.log 2024-09-17T11:00:37.397 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54083.log 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46944.log.gz 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34929.log 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56318.log.gz 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58847.log 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54083.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56741.log /var/log/ceph/ceph-client.admin.34929.log: 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54083.log.gz 2024-09-17T11:00:37.398 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34929.log.gz 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 /var/log/ceph/ceph-client.admin.58847.log: --verbose -- /var/log/ceph/ceph-client.admin.29202.log 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58847.log.gz 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33186.log 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.56741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56741.log.gz 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32489.log 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29202.log.gz 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55637.log 2024-09-17T11:00:37.399 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33186.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33186.log.gz 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32489.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32489.log.gz 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60513.log 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55637.log.gz 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.60513.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43532.log 2024-09-17T11:00:37.400 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60513.log.gz 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41399.log 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.48392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26228.log 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43532.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43532.log.gz 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51047.log 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41399.log.gz 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46987.log /var/log/ceph/ceph-client.admin.26228.log: 2024-09-17T11:00:37.401 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26228.log.gz 2024-09-17T11:00:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.51047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51047.log.gz 2024-09-17T11:00:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37238.log 2024-09-17T11:00:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37391.log 2024-09-17T11:00:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46987.log: /var/log/ceph/ceph-client.admin.37238.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.46776.log 2024-09-17T11:00:37.404 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46987.log.gz 2024-09-17T11:00:37.404 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37238.log.gz 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37391.log.gz 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46563.log 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46776.log.gz 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.43709.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63099.log 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50429.log 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46563.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28840.log 2024-09-17T11:00:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63099.log: -- replaced with /var/log/ceph/ceph-client.admin.46563.log.gz 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63099.log.gz 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67088.log 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50429.log.gz 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67332.log 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44510.log 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28840.log.gz 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67088.log.gz 2024-09-17T11:00:37.406 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58635.log 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67332.log.gz 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37085.log 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44510.log: 23.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28007.log 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44510.log.gz/var/log/ceph/ceph-client.admin.58635.log: 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58635.log.gz 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50408.log 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37085.log.gz 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2024-09-17T11:00:37.407 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28007.log.gz 2024-09-17T11:00:37.408 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70826.log 2024-09-17T11:00:37.408 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50408.log.gz 2024-09-17T11:00:37.408 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38351.log 2024-09-17T11:00:37.408 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-09-17T11:00:37.408 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66379.log 2024-09-17T11:00:37.408 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70826.log.gz 2024-09-17T11:00:37.408 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55319.log 2024-09-17T11:00:37.409 INFO:teuthology.orchestra.run.smithi184.stderr: 22.3% -- replaced with /var/log/ceph/ceph-client.admin.38351.log.gz 2024-09-17T11:00:37.409 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41923.log 2024-09-17T11:00:37.409 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66379.log.gz 2024-09-17T11:00:37.409 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32795.log 2024-09-17T11:00:37.409 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55319.log.gz 2024-09-17T11:00:37.409 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48018.log 2024-09-17T11:00:37.409 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41923.log: 52.7% -- replaced with /var/log/ceph/ceph-client.admin.41923.log.gz 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37408.log 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.32795.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32795.log.gz 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.48018.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43330.log 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48018.log.gz 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52266.log 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37408.log.gz 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37889.log 2024-09-17T11:00:37.410 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43330.log: 21.5% -- replaced with /var/log/ceph/ceph-client.admin.43330.log.gz 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.52266.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35769.log 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52266.log.gz 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.37889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49060.log 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37889.log.gz 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40778.log 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35769.log.gz 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68566.log 2024-09-17T11:00:37.411 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49060.log.gz 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58202.log 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.40778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61777.log 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40778.log.gz 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68566.log.gz 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35549.log 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58202.log.gz 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2024-09-17T11:00:37.412 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61777.log.gz 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69376.log 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54837.log 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35549.log.gz 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69376.log.gz 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53675.log 2024-09-17T11:00:37.413 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54837.log.gz 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.44189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61426.log 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36558.log 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53675.log.gz 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53196.log 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61426.log.gz 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70745.log 2024-09-17T11:00:37.414 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36558.log.gz 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46815.log 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.53196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53196.log.gz 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60555.log 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70745.log.gz 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26124.log 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46815.log.gz 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28324.log 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60555.log.gz 2024-09-17T11:00:37.415 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31505.log 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.26124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26124.log.gz 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.28324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28324.log.gz 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47937.log 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.31505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66680.log 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0%/var/log/ceph/ceph-client.admin.43750.log: -- replaced with /var/log/ceph/ceph-client.admin.31505.log.gz 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr: 2.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67110.log 2024-09-17T11:00:37.416 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gz 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47937.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69612.log 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47937.log.gz 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66680.log.gz 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49211.log 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67110.log.gz 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.69612.log: /var/log/ceph/ceph-client.admin.49211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54858.log 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69612.log.gz 2024-09-17T11:00:37.417 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49211.log.gz 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50072.log 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62346.log 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.54858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54858.log.gz 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58066.log 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50072.log: /var/log/ceph/ceph-client.admin.62346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50072.log.gz 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52287.log 2024-09-17T11:00:37.418 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62346.log.gz 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36388.log 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58066.log.gz 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61543.log 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.52287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52287.log.gz 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50897.log 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36388.log.gz 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31784.log 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.61543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61543.log.gz 2024-09-17T11:00:37.419 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58911.log 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50897.log.gz 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.31784.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70529.log 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31784.log.gz 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.58911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29063.log 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58911.log.gz 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.70529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70529.log.gz 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.29063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33681.log 2024-09-17T11:00:37.420 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29063.log.gz 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64538.log 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.49771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35169.log 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33681.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33681.log.gz 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.64538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47395.log 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64538.log.gz 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.17289.log 2024-09-17T11:00:37.421 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35169.log.gz 2024-09-17T11:00:37.422 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38225.log 2024-09-17T11:00:37.422 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.47395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60378.log 2024-09-17T11:00:37.422 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2024-09-17T11:00:37.422 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.tmp-client.admin.17289.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.17289.log.gz 2024-09-17T11:00:37.422 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70879.log 2024-09-17T11:00:37.422 INFO:teuthology.orchestra.run.smithi184.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38225.log.gz 2024-09-17T11:00:37.422 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68821.log 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60378.log: /var/log/ceph/ceph-client.admin.70879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63985.log 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60378.log.gz 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70879.log.gz 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45362.log 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.68821.log.gz 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.63985.log: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.63985.log.gz 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46229.log 2024-09-17T11:00:37.423 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.45362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45362.log.gz 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41592.log 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41964.log 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.46229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46229.log.gz 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41592.log: /var/log/ceph/ceph-client.admin.42043.log 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41592.log.gz 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60115.log 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.41964.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.41964.log.gz 2024-09-17T11:00:37.424 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.42043.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.42043.log.gz 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66035.log 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55466.log 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.60115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60115.log.gz 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.66035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66035.log.gz 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68609.log 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.55466.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65110.log 2024-09-17T11:00:37.425 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55466.log.gz 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.43143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.68609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68609.log.gz 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33647.log 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:gzip /var/log/ceph/ceph-client.admin.65110.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25720.log 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65110.log.gz 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33647.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33647.log.gz 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39087.log 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2024-09-17T11:00:37.426 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25720.log.gz 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36626.log 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.39087.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.39087.log.gz 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.33594.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50554.log 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.36626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36626.log.gz 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34089.log 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67480.log 2024-09-17T11:00:37.427 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.50554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50554.log.gz 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59126.log 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.34089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34089.log.gz 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38961.log 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.67480.log: gzip 0.0%-5 --verbose -- /var/log/ceph/ceph-client.admin.57671.log 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67480.log.gz 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.59126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59126.log.gz 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38961.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38961.log.gz 2024-09-17T11:00:37.428 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.57671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57671.log.gz 2024-09-17T11:00:37.809 INFO:teuthology.orchestra.run.smithi184.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T11:00:39.691 INFO:teuthology.orchestra.run.smithi184.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T11:00:40.053 INFO:teuthology.orchestra.run.smithi184.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T11:00:59.519 INFO:teuthology.orchestra.run.smithi184.stderr: 96.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T11:01:10.499 INFO:teuthology.orchestra.run.smithi184.stderr: 96.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T11:01:10.500 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-09-17T11:01:10.500 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m34.300s 2024-09-17T11:01:10.501 INFO:teuthology.orchestra.run.smithi184.stderr:user 1m3.417s 2024-09-17T11:01:10.501 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m3.094s 2024-09-17T11:01:10.501 INFO:tasks.ceph:Archiving logs... 2024-09-17T11:01:10.501 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7908726/remote/smithi184/log 2024-09-17T11:01:10.503 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T11:01:19.473 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T11:01:19.481 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T11:01:19.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T11:01:19.523 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T11:01:19.531 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T11:01:19.532 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T11:01:19.559 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T11:01:19.560 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2024-09-17T11:01:19.560 INFO:teuthology.orchestra.run.smithi184.stdout:+hv01.front.sepi 67.205.162.81 3 u 306 512 377 0.193 1.536 0.202 2024-09-17T11:01:19.560 INFO:teuthology.orchestra.run.smithi184.stdout:*hv02.front.sepi 63.231.80.2 3 u 328 512 377 0.191 -0.129 0.661 2024-09-17T11:01:19.560 INFO:teuthology.orchestra.run.smithi184.stdout:+hv03.front.sepi 74.6.168.72 3 u 292 512 377 0.135 0.413 0.313 2024-09-17T11:01:19.560 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-09-17T11:01:19.561 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T11:01:19.570 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T11:01:19.570 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T11:01:19.579 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T11:01:19.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T11:01:19.596 INFO:teuthology.task.internal:Duration was 11969.122341 seconds 2024-09-17T11:01:19.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T11:01:19.605 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T11:01:19.605 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T11:01:19.660 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T11:01:19.660 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-09-17T11:01:19.661 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T11:01:19.672 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T11:01:19.673 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T11:01:19.703 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T11:01:19.703 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T11:01:19.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T11:01:19.779 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T11:01:19.779 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T11:01:19.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T11:01:19.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T11:01:19.814 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-09-17T11:01:19.887 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T11:01:19.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T11:01:19.936 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T11:01:19.946 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T11:01:19.946 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/sangadi-2024-09-17_07:28:46-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7908726/remote/smithi184 2024-09-17T11:01:19.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T11:01:19.970 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T11:01:19.970 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T11:01:19.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T11:01:19.986 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T11:01:19.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T11:01:19.996 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T11:01:19.996 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T11:01:20.030 INFO:teuthology.orchestra.run.smithi184.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 17 11:01 /home/ubuntu/cephtest 2024-09-17T11:01:20.030 INFO:teuthology.orchestra.run.smithi184.stdout: 1068703 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 17 07:50 /home/ubuntu/cephtest/mnt.0 2024-09-17T11:01:20.030 INFO:teuthology.orchestra.run.smithi184.stdout: 1068704 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 17 07:51 /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T11:01:20.030 INFO:teuthology.orchestra.run.smithi184.stdout: 1194409 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 17 07:51 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T11:01:20.031 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-17T11:01:20.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T11:01:20.033 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi184 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-17T11:01:20.042 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T11:01:20.053 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T11:01:20.062 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi184 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-17T11:01:20.066 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} duration: 11969.122341394424 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi184 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_sangadi@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9d834db987f54059aa5a0251b98c2290 status: fail success: false 2024-09-17T11:01:20.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T11:01:20.179 INFO:teuthology.run:FAIL